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A  MATHEMATICAL  THEORY  OF  COMMAND  AND  CONTROL  STRUCTURES 


SUMMARY 
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The  elements  of  a  mathematical  theory  for  the  analysis  and  design  of 
organizations  are  presented.  The  focus  of  the  research  has  been \  on 


Information  processing  and  decisionmaking  organizations  supported  by 
systems.  The  mathematical  framework  used  In  modeling  the  individual 
decisionmakers,  as  well  as  the  organization.  Is  that  of  n-dlmenslonal 
Information  theory.  Petri  Net  representation  of  the  organizational 
structure  Is  used  to  model  the  Interactions  between  organization  members  as 
well  as  their  Interactions  with  the  C^  system.  Comparison  and  evaluation  of 
alternative  organizational  forms  Is  accomplished  by  considering 
organizational  performance.  Individual  workload  and  the  sets  of  satisficing 
decision  strategies. 


A  brief  description  of  research  on  distributed  estimation  and  on 
Information  storage  and  flow  In  C^  systems  Is  also  Included. 


ATT?  Pr'T 


ill 


Or2 


«  #> 

•'  ?* 

'■'  V 

•  * 

TABLE  OF  CONTENTS 

••■  -/..•  vvv^ 

SlIBMiry  itumut . m“ . IT . . . 

Page 

.  iii 

Tabla  of  Contents  ...... . . . . . . . . 

’  .  7 

M  j»fe  rtf  T1 1  uat.paf  <  rtnn  .  .  . . . . . . . 

1 .0  INTRODUCTION  . 

.  1 

1  o  C^  SYSTEM  STRUCTURE  AND  ORGANIZATIONAL  FORMS  . 

.  2 

L* 

2.1  Suaaary . 

■ 

2.2  Ths  Danfftn  Pr^bln  ................ _ ............ 

: !- 
Y*; 

2.3  Inf  or—"*-  * nn  Theoretic  PraiMinpli  ... _ ............ 

.  6 

2 .4  Tank  Hod^l  tut. .............. ....................... 

»  M*,r 

2.5  Model  of  the  Organization  Heater  . 

1  K  Omni *»H nnal  Fora  ....... _ _ .................... 

- 

2.7  Analysis  of  Organisations  . 

2.8  Conclusion  .... _ _ _ ...................... 

.  «■• 

3.0  OTHER  TASKS  . 

.  29 

1 3 

3 el  Dtototn  1  i E^tliatl^n  . . . . . 

V;**« 

s 

3.2  TnfAPnt1nf  SfcAnaaa  and  Flow  In  CJ  Svstees  .......... 

.  30 

LS 

f  •  ’•  i . 

3.3  Distributed  Deoision  Probleas  in  Dynamic  Missile 

Reassignaent  Strategies  . . 

-•/  ’  "• 

4.0  REFERENCES . . . 

■ '.. 

V 

_ 

APPENDIX  A:  PUBLICATIONS 


APPENDIX  B:  'Decentralized  Estiaation  of  Linear  Gaussian  Systeas" 
by  David  A.  Castaffon 

APPENDIX  C:  "TEGCNET:  A  Software  Testbed  for  Use  in  C3  Systea 
Research"  by  Elizabeth  R.  Ducot 


Figure  1.  Information  structures  for  organizations 
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1.  IHTBODOCTION 

The  analysis  of  generic  aspects  of  C*  systems  represents  an  area  of 
research  that  requires  the  integration  of  diverse  concepts  and  theories,  if 
progress  is  to  be  made  toward  the  development  of  a  theoretical  basis  of 
their  analysis  and  design. 

The  technical  effort  of  this  project  was  directed  toward  generic,  long 
range,  basic,  unclassified  research.  The  emphasis  was  on  general 
methodological  and  technical  issues,  but  from  the  perspective  of  the  unique 
needs  and  requirements  of  the  Air  Force.  The  main  research  area  was  "C* 
System  Structure  and  Organisational  Forms*.  The  goal  of  this  effort  was  the 
development  of  a  mathematical  theory  for  the  analysis  and  design  of  tactical 
military  organizations  supported  by  C*  systems.  The  results  of  this  work 
are  presented  at  length  in  this  report. 

During  the  period  of  performance  of  this  projeot  several  other  tasks 
were  undertaken  in  parallel  with  the  first  one,  each  one  lasting  from  one  to 
two  years.  Bach  of  these  tasks  addressed  specific  aspects  of  the  basic 
theoretical  problems  posed  by  the  presence  of  C*  systems  in  a  distributed 
decisionmaking  environment.  They  include  (a)  Decentralized  Estimation 
(D.A.  CastaBon) ;  (b)  Information  Storage  and  Flow  in  C*  Systems  (E.R. 
Ducot);  (c)  Distributed  Decision  Problems  in  Dynamic  Missile  Reassignment 
Strategies  (M.  Athens) .  Technical  papers  that  present  the  significant 
developments  in  task  (a)  and  (b)  are  inoluded  in  appendices  B  and  C, 
respectively. 

A  list  of  documents  resulting  from  research  carried  under  this  project 
is  included  in  Appendix  A. 
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2.0  C*  SYSTEM  STBOCTUHE  AND  ORGANIZATIONAL  FORMS 
2.1  Summary 

Research  in  this  area  has  been  focused  on  the  development  of  a 
mathematical  theory  for  the  modeling  and  analysis  of  information-processing 
and  decisionmaking  organizations.  The  specific  organizational  structures 
considered  were  motivated  by  tactical  Air  Force  C*  systems,  perceived  as 
support  systems  for  the  decisionmakers. 

The  first  problem  addressed  was  the  development  of  a  model  of  the 
decisionmaking  process  applicable  to  human  decisionmaking  in  tactical 
situations.  A  model  was  developed  using  the  analytical  framework  of  n- 
dimenaional  Information  theory.  The  interactions  with  other  decisionmakers 
were  modeled  in  terms  of  sharing  situation  assessment  information  and 
issuing  or  receiving  commands  that  restrlot  the  selection  of  outputs  or 
responses. 

The  theory  developed  for  the  single  interacting  decisionmaker  was  then 
extended  to  teams  of  decisionmakers  forming  an  organization.  There  are 
three  parts  to  the  formultlon  of  the  design  problem:  (a)  Analytic 
characterisation  of  the  task  the  organization  is  to  perform:  (b) 
Specification  of  the  interactions  between  organization  members  and  the 
environment,  i.e.,  who  receives  what  external  inputs  and  who  produces  the 
organisation's  outputs:  and  (c)  Specification  of  the  interactions  between 
organisation  members.  These  include  the  sharing  of  situation  assessment 
information  and  the  issuing  and  receiving  of  commands . 

The  theory  in  its  ourrent  fora  is  applicable  to  organizations  with 
aoyolioal  information  structures,  i.e.,  organizations  whose  digraphs 
depiotlng  information  flow  do  not  contain  loops.  The  conventional 
workloed-perforaanoe  plane  for  the  alngle  decisionmaker  has  been  extended  to 
n+1  dimensions  with  the  n  dimensions  corresponding  to  the  workload  of  each 
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one  of  the  n  members  of  the  organization  and  the  (n+l)st  dimension  to  the 
performance  measure  for  the  organization.  The  theoretical  development  has 
been  illustrated  by  designing  and  evaluating  two  three-person  organizations 
assigned  to  carry  an  abstracted  air  defense  task. 

In  the  early  work,  the  internal  structure  of  the  decisionmaking 
systems  had  been  modeled  as  memoryless.  In  order  to  develop  more  realistic 
models  in  the  context  of  the  coamand  and  control  process,  it  became 
necessary  to  introduce  memory  in  the  information  theoretic  framework  so  that 
inputs  that  are  statistically  dependent  could  be  considered. 

Three  types  of  storage  have  been  modeled:  buffer  storage,  temporary 
memory  and  permanent  memory.  Since  this  analysis  addressed  the  processing 
of  sequential  inputs  that  are  dependent  on  each  other,  information  rates  and 
the  Partition  Law  for  Information  Rates  were  used.  Consequently,  Inputs 
were  modeled  by  discrete  stationary  ergodic  sources.  The  model  of  permanent 
memory  was  then  used  to  analyze  a  typical  situation  for  a  decisionmaker:  the 
processing  of  two  distinct  tasks  in  parallel  —  the  dual  task  problem. 

The  model  of  the  decisionmaking  process  contains  a  set  of  algorithms  in 
the  situation  assessment  stage  and  another  set  in  the  response  selection 
stage.  For  the  early  version  of  the  model,  the  simplifying  assumption  was 
made  that  the  algorithms  were  deterministic.  The  theory  has  since  been 
extended  to  include  stochastic  algorithms.  As  expected,  it  was  shown  that 
the  presence  of  non-deterministic  algorithms  increases  the  total  activity  by 
increasing  the  component  that  corresponds  to  internally  generated 
Information  or  noise. 

The  modeling  of  preprocessors  of  various  types  was  also  considered.  The 
objective  was  to  develop  an  analytical  formulation  of  the  problem  of 
Introducing  decision  aids  in  an  organization.  Both  deterministic  and 
stochastic  preprocessors  have  been  studied  and  their  effect  on  workload  and 
performance  has  been  investigated. 


a*  4'  H  er*  •  f.  If  a  f,  f. 


Finally,  an  additional  task  was  introduced,  namely,  the  modeling  of  the 
organizations  using  the  Petri  Net  formalism  so  that  the  organizational  delay 
could  be  evaluated.  A  system  matrix  for  synchronous  protocols  was  defined 
and  an  algorithm  for  calculating  delays  was  implemented  and  tested  on  the 
two  three-person  organizations. 

A  comprehensive  review  of  the  approach  and  the  results  is  presented  in 
the  following  sections. 

2.2  The  Design  Problem 

In  considering  organizational  structures  for  teams  of  decisionmakers,  a 
designer  must  address  the  questions  of  who  reoeives  what  information  and  who 
is  assigned  to  make  which  decisions.  The  resolution  of  these  questions 
specifies  the  organizational  form.  The  designer's  problem  is  the  selection 
of  a  form  so  that  the  resulting  organization  meets  its  performance 
specifications  and  the  individual  members  are  not  overloaded,  i.e.,  the  task 
requirements  do  not  exceed  their  individual  processing  limitations. 


While  the  role  of  the  human  decisionmakers  is  central  to  the  design 
problem,  the  latter  cannot  be  decoupled  from  the  consideration  of  the 
information  system  that  supports  the  organization.  Consider,  for  example,  a 
tactical  military  organization  supported  by  a  comnand,  control,  and 
communications  (C*)  system.  Information  is  collected  from  many  sources, 
distributed  to  appropriate  units  in  the  organization  for  processing,  and 
used  by  the  commanders  and  their  staff  to  make  decisions.  These  decisions 
are  then  passed  to  the  units  responsible  for  carrying  them  out.  Thus,  a 
given  organization  design  implies  the  existence  of  a  C*  system  that  supports 
it.  Conversely,  the  presence  of  a  C*  system  in  support  of  an  organization 
modifies  the  latter's  operations;  it  may  create  operational  modes  not 
foreseen  during  the  organizational  design  phase.  Therefore,  if  a 
quantitative  description  of  the  organization  design  problem  is  to  be 
developed,  it  must  take  into  account  not  only  the  organization  members,  but 


also  the  collection  of  equipment  and  procedures  that  constitute  the 
organisation's  C*  systea. 

In  order  to  develop  a  quantitative  methodology  for  the  analysis  and 
evaluation  of  information  processing  and  decisionmaking  organizations,  it  is 
necessary  that  a  set  of  compatible  models  be  obtained  that  describe  the 
organization  and  its  environment.  This  modeling  effort  has  been  divided  in 
three  steps.  The  first  one  is  the  modeling  of  the  tasks  the  organization  is 
to  execute  and  the  definition  of  the  boundary  between  the  organization  and 
its  environment.  The  second  step  is  the  selection  of  mathematical  models 
that  describe  the  members  of  the  organization.  The  third  step  is  the 
modeling  of  organizational  form,  i.e.,  the  specification  of  the  information 
and  decision  structures  that  characterize  the  organization.  This  step 
includes  the  specification  of  the  protocols  for  information  exchange  and  the 
modeling  of  the  communication  systems,  the  data  bases,  and  the  decision  aids 
that  the  organization  uses  to  perform  its  tasks. 

The  methodology  Itself  consists  of  two  main  parts.  In  the  first  one, 
the  analysis  of  the  organization,  the  models  are  used  to  describe  the 
organization  in  terms  of  a  locus  defined  on  a  generalized  performance  - 
workload  space.  This  locus  is  obtained  by  computing  an  index  of  performance 
for  the  organization  and  measures  of  the  workload  for  each  individual  member 
of  the  organization  as  functions  of  the  admissible  decision  strategies  used 
by  the  decisionmakers.  The  second  part  of  the  methodology  addresses  the 
question  of  evaluating  organizational  designs  and  comparing  alternative 
structures. 

The  analytical  framework  used  for  modeling  the  tasks,  the  individual 
organization  members,  the  C*  systea,  and  the  organization  as  a  whole  is  that 
of  nrdiaenaional  information  theory  [1] .  A  brief  description  of  the  key 
quantities  and  of  the  partition  law  of  information  [2]  is  presented  in  the 
next  section. 


2.3  Information  Theoretic  Framework 

Information  theory  was  first  developed  as  an  application  in 
communication  theory  [3].  But.  as  Khlnchin  [4]  showed,  it  is  also  a  valid 
mathematical  theory  in  its  own  right,  and  it  is  useful  for  applications  in 
many  disciplines.  Including  the  modeling  of  simple  human  decisionmaking 
processes  [5]  and  the  analysis  of  information-processing  systems. 

There  are  two  quantities  of  primary  interest  in  information  theory.  The 
first  of  these  is  entropy ;  given  a  variable  x,  which  is  an  element  of  the 
alphabet  X,  and  occurs  with  probability  p(x),  the  entropy  of  x,  H(x).  is 
defined  to  be 

H(x)  ■  ^  p(x)  log  p(x)  (2.1) 

x 

and  is  measured  in  bits  when  the  base  of  the  algorithm  is  two.  The  other 
quantity  of  interest  is  average  mutual  information  or  transmission:  given 
two  variables  x  and  y,  elements  of  the  alphabets  X  and  Y,  and  given  p(x) , 
p(y),  and  p(xly)  (the  conditional  probability  of  x,  given  the  value  of  y) , 
the  transmission  between  x  and  y,  T(x:y)  is  defined  to  be 

T(x:y)  ■  H(x)  -  Hy(x)  (2.2) 

where 

Hy(x)  ■  -  ^  p(y)  ^  p(x|y)  log  p(xly)  (2.3) 

y  X 

is  the  conditional  uncertainty  in  the  variable  x,  given  full  knowledge  of 
the  value  of  the  variable  y. 


MoGill  (1]  generalized  this  basic  two-variable  input-output  theory  to  N 
dimensions  by  extending  Eq.  (2.2): 

N 

T(xx:xa: ...:xN)  ■  ^  H(xi>  -  H(xa»xa . . »xN)  (2.4) 

i-1 

For  the  modeling  of  memory  and  of  sequential  inputs  which  are  dependent 
on  each  other,  the  use  of  the  entropy  rate.  H(x),  which  describes  the 
average  entropy  of  x  per  unit  time,  is  appropriate: 

H(x)  ■  lim  —  H[x(t).  x(t+l) , . . . ,x(t+m-l) ]  (2.5) 

D 

Transmission  rates.  T(x:y).  are  defined  exactly  like  transmission,  but  using 
entropy  rates  in  the  definition  rather  than  entropies. 

The  Partition  Law  of  Information  [2]  is  defined  for  a  system  with  N-l 
internal  variables.  vx  through  wN_t.  and  an  output  variable,  y.  also  called 
wN.  The  law  states 

N 

^  H(wi)  -  T(x:y)  +  Ty(x:wa,wa,...,wIJ_a)  +  T(wa:wa : . . .  :wN_1  :y) 
i-1 

+  Hx(wa,w# ....  »Wjj_a,y)  (2.6) 

and  is  easily  derived  using  information  theoretic  identities.  The  left-hand 
side  of  (2.6)  refers  to  the  total  activity  of  the  system,  also  designated  by 
0.  Each  of  the  quantities  on  the  right-hand  side  has  its  own 
Interpretation.  The  first  term.  T(x:y),  is  called  throughput  and  is 
designated  Gt.  It  measures  the  amount  by  which  the  output  of  the  system  is 
related  to  the  input.  The  seoond  quantity. 
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Ty(x: V1,w> .... *wn_j)  *  T(x:wi»w>,....wn_1.y)  -  T(x:y)  (2.7) 

is  called  blockage  and  is  designated  Gb.  Blockage  may  be  thought  of  as  the 
amount  of  information  in  the  input  to  the  system  that  is  not  included  in  the 
output.  The  third  term,  T(w1:w1:...:tij|_1:y)  is  called  coordination  and 
designated  Gc.  It  is  the  N-dimensional  transmission  of  the  system,  i.e., 
the  amount  by  which  all  of  the  internal  variables  in  the  system  constrain 
each  other.  The  last  term,  Hx(wx,wJ, . . . ,wN_x,y) ,  designated  by  Gn 
represents  the  uncertainty  that  remains  in  the  system  variables  when  the 
input  is  completely  known.  This  noise  should  not  be  construed  to  be 
necessarily  undesirable,  as  it  is  in  communication  theory:  it  may  also  be 
thought  of  as  internally-generated  information  supplied  by  the  system  to 
supplement  the  input  and  facilitate  the  decisionmaking  process.  The 
partition  law  may  be  abbreviated: 

G  ■  G.  +  G.  +  G  +  G  (2.8) 

t  b  c  n 

A  statement  completely  analogous  to  (2.8)  can  be  made  about  information 
rates  by  substituting  entropy  rate  and  transmission  rates  in  (2.0. 


2.4  Task  Model  [6,7] 

The  organization,  perceived  as  an  open  system  [8],  interacts  with  its 
environment:  it  receives  signals  or  messages  in  various  forms  that  contain 
information  relevant  to  the  organization's  tasks.  These  messages  must  be 
identified,  analyzed,  and  transmitted  to  their  appropriate  destinations 
within  the  organization.  From  this  perspective,  the  organization  acts  as  an 
Information  user. 

Let  the  organization  receive  data  from  one  or  more  sources  external  to 
it.  Every  xn  units  of  time  on  the  average,  each  aouroe  n  generates  symbols. 


r 


« 


ri*-* 


signals,  or  messages  xni  from  its  associated  alphabet  XQ>  with  probability 
Pni*  *•••» 


»nl  '  p<In"xnl)  1  xni  *  *n  1  *  1-1 . rn 


(2.9) 


j  Pnl-1  ,  n-1.2 . N- 


(2.10) 


where  jn  is  the  dimension  of  xn.  Therefore,  l/t_  is  the  mean  frequency  of 


symbol  generation  from  source  n. 


The  organization's  task  is  defined  as  the  processing  of  the  input 
symbols  Xg  to  produce  output  symbols.  This  definition  Implies  that  the 
organization  designer  knows  a  priori  the  set  of  desired  responses  T  and, 
furthermore,  has  a  function  or  table  L(xQ)  that  associates  a  desired 
response  or  a  set  of  desired  responses,  elements  of  Y,  to  each  input  xQ  e 


It  is  assumed  that  a  specific  oomplex  task  that  must  be  performed  can 
be  modeled  by  N*  sources  of  data.  Rather  than  considering  these  sources 
separately,  one  supersource  composed  of  these  N'  sources  is  created.  The 
input  symbol  x*  may  be  represented  by  an  N' -dimensional  vector  with  each  of 
the  sources  represented  by  a  component  of  this  vector,  i.e.. 


X'  ■  (x1,x#1 


x'  •  X 


(2.11) 


To  determine  the  probability  that  symbol  xj  is  generated,  the 
independence  between  components  must  be  considered.  If  all  components  are 
mutually  independent,  then  Pj  is  the  produot  of  the  probabilities  that  each 
component  of  xj  takes  on  its  respective  value  from  its  associated  alphabet: 


\»,v;vs  <rA\Y 


(2.12) 


If  two  or  more  components  are  probabilistically  dependent  on  each  other,  but 
as  a  group  are  mutually  independent  from  all  other  components  of  the  input 
vector.  then  these  dependent  components  can  be  treated  as  one 
supercomponent,  with  a  new  alphabet.  Then  a  new  input  vector,  x.  is 
defined,  composed  of  the  mutually  independent  components  and  these  super¬ 
components  . 

This  model  of  the  sources  Implies  synchronization  between  the 
generation  of  the  individual  source  elements  so  that  they  may,  in  fact,  be 
treated  as  one  input  symbol.  Specifically,  it  is  assumed  that  the  mean 
interarrival  time  for  each  component  tQ  is  equal  to  t.  It  is  also  assumed 
that  the  generation  of  a  particular  input  vector,  Xj,  is  independent  of  the 
symbols  generated  prior  to  or  after  it. 

The  last  assumption  can  be  weakened,  if  the  source  is  a  discrete 
stationary  ergodic  one  with  constant  interarrival  time  x  that  could  be 
approximated  by  a  Harkov  source.  Then  the  information  theoretic  framework 
can  be  retained  [6] . 

The  vector  output  of  the  source  is  partitioned  into  groups  of 
components  that  are  assigned  to  different  organization  members.  The  j-th 
partition  is  denoted  by  x^  and  is  derived  from  the  corresponding  partition 
matrix  which  has  dimension  Dj  x  N  and  rank  nj,  i.e., 

x**  -  x.  (2.13) 

Each  column  of  has  at  most  one  non-zero  element.  The  resulting  vectors 
X')  may  have  some,  all,  or  no  components  in  oommon. 

The  set  of  partitioning  matrices  (a*  »** » • • • # «n)  shown  in  Figure  1 
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specify  the  coaponents  of  the  input  vector  received  by  each  member  of  the 
subset  of  decisionmakers  that  interact  directly  with  the  organization's 
environment.  These  assignments  can  be  time  invariant  or  time  varying.  In 
the  latter  case,  the  partition  matrix  can  be  expressed  as 

(  for  t  «  T 

nJ(t)  -  {  (2.14) 
10  for  t  ^  T 

The  times  at  whioh  a  decisionmaker  receives  inputs  for  processing  can  be 
obtained  either  through  a  deterministic  (e.g..  periodic)  or  a  stochastic 
rule.  The  question  of  how  to  select  the  set  of  partition  matrices,  i.e., 
design  the  information  structure  between  the  environment  and  the 
organization,  has  been  addressed  by  Stabile  [7,9]. 


Figure  1.  Information  Structures  for  Organizations 
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2.5  Model  of  the  Organization  Member  I10.ll.12] 


The  complete  realization  of  the  model  of  the  decisionmaker  (DM)  who  is 
interacting  with  other  organization  members  and  with  the  environment  is 
shown  schematically  in  Figure  2. 


Figure  2.  The  Interacting  Decisionmaker  with  Memory 

The  DM  receives  singals  x  *  X  from  the  environment  with  interarrival 
time  x.  A  string  of  signals  may  be  stored  first  in  a  buffer  so  that  they 
can  be  processed  together  in  the  situation  assessment  (SA)  stage.  The  SA 
stage  contains  algorithms  that  process  the  incoming  signals  to  obtain  the 
assessed  situation  z.  The  SA  stage  may  access  the  memory  or  internal  data 
base  to  obtain  a  set  of  values  dQ.  The  assessed  situation  z  may  be  shared 
with  other  organization  members i  concurrently,  the  DM  may  receive  the 
supplementary  situation  assessment  z '  from  other  parts  of  the  organization; 
the  two  sets  z  and  z'  are  oombined  in  the  information  fusion  (IF)  processing 
stage  to  obtain  Z.  Some  of  the  data  (dj)  from  the  IF  process  may  be  stored 
in  memory . 

The  possibility  of  receiving  oommands  from  other  organization  members 
is  modeled  by  the  variable  v’  and  a  command  interpretation  (Cl)  stage  of 
processing  is  neoessary  to  oombine  the  situation  assessment  Z  and  v'  to 


arrive  at  the  choice  ?  of  the  appropriate  strategy  to  use  in  the  response 
selection  (RS)  stage.  The  R S  stage  oontains  algorithms  that  produce  outputs 
y  in  response  to  the  Situation  assessment  Z  and  the  conmand  inputs.  The  RS 
stage  may  aooess  data  from  or  store  data  in  memory  [6,13]. 

A  more  detailed  description  of  the  decisionmaker  model  without  buffer 
or  memory  is  shown  in  Figure  3.  This  figure  shows  the  internal  structure  of 
the  four  processing  stages:  SA,  IF,  Cl,  and  RS.  The  situation  assessment 
stage  consists  of  a  set  of  U  algorithms  (deterministic  or  not)  that  are 
capable  of  producing  some  situation  assessment  z.  The  choice  of  algorithms 
is  achieved  through  speoifioation  of  the  internal  variable  u  in  aooordance 
with  the  situation  assessment  strategy  p(u)  or  p(u|x) ,  if  a  decision  aid 
(e.g.,  a  preprocessor)  is  present.  A  second  internal  decision  is  the 
selection  of  the  algorithm  in  the  RS  stage  according  to  the  response 
seleotion  strategy  p(V|f ,v' ) .  The  two  strategies,  when  taken  together, 
constitute  the  internal  decision  strategy  of  the  decisionmaker. 


Z  Z  V 


Figure  3.  Detailed  Model  of  the  Interacting  Decisionmaker 


The  analytical  framework  presented  in  Seotion  2.3,  when  applied  to  the 
single  interacting  decisionmaker  with  deterministic  algorithms  in  the  SA  and 
RS  stages,  yields  the  four  aggregate  quantities  that  characterize  the 


information  processing  and  deoisionmaking  activity  within  the  DM  [10,12]: 


Qfc  -  T(x,z',v':z,y) 


(2.15) 


0.  -  H(x.z',v')  -  G. 

D  t 

Internally  generated  information: 

Gn  -  H(u)  -  Hj(v) 


(2.16) 


(2.18) 


a 

0o-  J  p&i*Cp<s»  +  a  H(p  )  +  H(z)  +  g^F(p(z,z'))  +  g^I(p(z,v,> 
i-1 


¥ 

+  5  PjgJ(P(*IV  -  J))  +  Oj  B(Pj)  +  H(y) 

J-l 

♦  H(z)  ♦  H(Z)  +  H(Z,¥)  +  T(x’ :z')  +  T,_(x' ,z':v')  (2.18) 

z  z 

The  expression  for  Gn  shows  that  it  depends  on  the  two  internal 
strategies  p(u)  and  p(v|Z)  even  though  a  command  input  may  exist.  This 
implies  that  the  oommand  input  v'  modifies  the  DM 'a  internal  decision  after 
p(v|Z)  has  been  determined. 


In  the  expressions  defining  the  system  coordination,  pi  is  the 
probability  that  algorithm  f^  has  been  selected  for  processing  the  input  x 
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u  =  i 


and  Pj  is  the  probability  that  algorithm  hj  has  been  selected,  i.e., 
and  f  ■  J.  The  quantities  gc  represent  the  internal  coordinations  of  the 
corresponding  algorithms  and  depend  on  the  distribution  of  their  respective 


inputs}  the  quantities  o^,  a are  the  number  of  internal  variables  of  the 
algorithms  f ^  and  h  j ,  respectively.  Finally,  the  quantity  H  is  the  entropy 
of  a  binary  random  variable:  * 


H(p)  -  -  plog2  p  -  (1  -  p)log2(l-p) 


(2.19) 


Equations  (2.15)  to  (2.18)  determine  the  total  activity  G  of  the 
decisionmaker  according  to  the  partition  law  of  information  (2.6).  The 
activity  G  can  be  evaluated  alternatively  as  the  sum  of  the  marginal 
uncertainties  of  each  system  variable.  For  any  given  internal  decision 
strategy,  G  and  its  component  parts  can  be  computed. 

Since  the  quantity  G  may  be  interpreted  as  the  total  information 
processing  activity  of  the  system,  it  can  serve  as  a  measure  of  the  workload 
of  the  organization  member  in  carrying  out  his  decisionmaking  task. 

The  qualitative  notion  that  the  rationality  of  a  human  decisionmaker  is 
not  perfeot,  but  is  bounded  [14] ,  has  been  modeled  as  a  constraint  on  the 
total  activity  G: 

G  “  G*  +  Gk  +  G„  +  G„  <  Ft  (2.20) 
tone  o 


where  xQ  is  the  symbol  interarrival  time  and  F  is  the  maximum  rate  of 
information  processing  that  characterizes  a  decisionmaker.  This  constraint 
implies  that  the  decisionmaker  must  process  his  input  at  a  rate  that  is 
least  equal  to  the  rate  with  which  they  arrive.  For  a  detailed  discussion 
of  this  particular  model  of  bounded  rationality,  see  Boettcher  and  Levis 
[10]. 

Weakening  the  assumption  that  the  algorithms  are  deterministic,  changes 


the  numerical  values  of  Gn  and  of  the  coordination  term  Gc  [IS] .  If  memory 
Is  present  In  the  model,  then  additional  terms  appear  in  the  expressions  for 
the  coordination  rate  and  for  the  internally  generated  information  rate 
[6.13]. 

2.6  Organizational  Form  t 

In  order  to  define  an  organizational  structure,  the  interactions 
between  the  human  decisionmakers  that  constitute  the  organization  must  be 
specified.  The  interactions  between  DMs  and  the  environment  have  already 
been  described  in  Section  2.4.  The  internal  interactions  between  DMs 
consist  of  receiving  inputs  from  other  DM's,  sharing  situation  assessments, 
receiving  command  inputs,  and  producing  outputs  that  are  either  inputs  or 
comands  to  other  DM's.  The  detailed  specification  of  the  interactions 
requires  the  determination  of  what  information  is  to  be  passed  among 
individual  organization  members  and  the  precise  sequence  of  processing 
events,  i.e.,  the  standard  operating  procedure  or  communication  and 
execution  protocol  of  the  organization. 

Information  structures  that  can  be  modeled  within  this  analytical 
framework  are  those  that  represent  synchronized,  acydical  information 
flows.  Since  inputs  are  assumed  to  arrive  at  a  fixed  average  rate,  the 
organization  is  constrained  to  produce  outputs  at  the  same  average  rate. 
The  overall  response  is  made  up,  in  general,  of  the  responses  of  several 
members)  therefore,  each  member  is  assumed  to  complete  the  processing 
corresponding  to  a  particular  input  at  the  same  average  rate. 

Within  this  overal  rate  synchronization,  however,  processing  of  a 
speoifio  input  symbol  or  vector  takes  place  in  an  asynchronous  manner.  If 
the  requisite  Inputs  for  a  particular  stage  of  processing  are  present,  then 
processing  can  begin  without  regard  to  any  other  stage,  which  implies  that 
concurrent  processing  is  present.  For  example,  as  soon  as  the  organization 
input  arrives  and  is  partitioned  through  n,  processing  of  x  begins  to  obtain 
z.  The  IF  stage  must  wait,  however,  until  both  the  z  and  z'  values  are 


present.  Each  stage  of  processing  is  thus  event -driven;  a  well-defined 
sequence  of  events  is  therefore  an  essential  element  of  the  model 
speoi fi cation. 

Aoydical  information  structures  are  those  whose  directed  graphs 
representing  the  flows  of  information  do  not  contain  any  cycles  or  loops. 
This  restriction  is  made  to  avoid  deadlock  and  circulation  of  messages 
within  the  organization.  Deadlock  occurs  when  one  DM  is  waiting  for  a 
message  from  another  in  order  to  proceed  with  his  task,  while  the  second  one 
is  in  turn  waiting  for  an  input  from  the  first. 

The  system  theoretic  representation  of  the  organizational  form  is 
useful  for  showing  the  various  processing  stages  or  subsystems.  For 
example,  in  Figure  4,  a  three  person  organization  is  shown  in  block  diagram 
form  in  which  the  first  and  third  members  send  information  to  the  second, 
who  in  turn  can  issue  commands  to  the  other  two  ms. 

Evaluation  of  the  various  information  theoretic  quantities,  including 
total  activity,  can  be  accomplished  readily,  using  the  decomposition 
property  of  the  information  theoretic  framework  [2].  However,  the 
internal  Information  structure  of  the  organization  is  often  ambiguous  when 
represented  in  block  diagram  terms.  For  example,  the  requirement  that  both 
zx%  and  zas  be  present  before  the  second  DM  can  fuse  the  information  is  not 
apparent  from  Figure  4.  An  alternate  representation  is  needed  which  shows 
explicitly  the  Information  structure  without  compromising  the  usefulness  of 
the  Information  theoretic  decomposition  property. 

Petri  Nets  [16]  and  the  data  flow-schema  [17,18]  have  been  developed  as 
models  of  information  flow  for  systems  with  asynchronous,  concurrent 
processing  activities.  Three  basic  elements  are  used  in  their  structure: 
places,  transitions,  and  directed  arcs  which  connect  the  two.  Places  and 
transitions  represent  conditions  and  events,  respectively.  No  event  occurs 
unless  the  requisite  conditions  are  met,  but  the  occurrence  of  an  event 
gives  rise  to  new  conditions.  Tokens  are  used  to  mark  which  conditions  are 


Figure  4.  Block  diagram  representation  of  three  person  organization 

in  effeotj  when  all  input  places  to  (conditions  for)  a  transition  contain  a 
token  (are  satisfied),  then  the  event  can  occur,  whioh  in  turn  results  in 
the  generation  of  tokens  for  output  places.  Since  tokens  are  carriers  of 
data,  each  transition  is  a  processor  which  generates  a  result  from  the  input 
data  and  deposits  it  on  an  output  token  which  then  along  a  directed  arc  to 
the  next  stage  of  processing. 

To  represent  the  information  theoretio  decisionmaking  model  using  the 
Petri  Net  formalism,  a  simple  translation  in  structure  is  made:  distinct 
Inputs  and  outputs  of  eaoh  subsystem  are  assigned  plaoes  and  the  processing 
within  a  subsystem  is  represented  by  a  transition  [19].  Associated  with 
eaoh  transition  is  the  set  of  internal  variables  of  the  subsystem,  exclusive 
of  the  input  variables,  which  are  accounted  for  separately  by  the  input 
plaoes.  By  assuming  a  probability  distribution  on  the  organization's 
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Inputs,  distributions  are  also  included  on  the  places  in  the  structure. 
Therefore,  distributions  are  also  present  on  subsystem  variables,  and  all 
information  theoretic  quantities  are  well-defined  and  can  be  computed  as 
before. 

The  organization  structure  shown  in  Figure  4,  represented  as  a  Petri 
Net  is  shown  in  Figure  5.  In  addition  to  places,  transitions,  and  directed 
arcs,  the  structure  contains  a  new  element,  the  switch.  This  is  a  logical 
element  which  direct  the  flow  of  tokens.  The  switch  may  take  values 
independently,  or  the  value  is  determined  as  a  result  of  the  processing  by 
algorithm  B  contained  in  the  command  input  block.  Since  the  structure  shown 
in  Figure  5  is  equivalent  to  the  system  theoretic  structure  in  Figure  4,  the 
internal  variable  definition  and  all  information  theoretic  quantities  remain 
unchanged.  However,  the  information  structure  of  the  organization  is  made 
explicit  in  Figure  5. 

Once  an  input  X  is  partitioned,  the  processing  by  each  DM  in  his 
respective  SA  stage  (algorithms  f)  begins  concurrently  and  asynchronously. 
This  is  evident  from  the  representation.  Note  that  because  of  the  assumed 
synchronization  with  respect  to  organization  inputs,  there  can  be  at  most 
one  data  token  in  any  single  place.  The  structure  is  obviously  acyclical 
and  deadlock  in  the  organization  is  prevented. 

The  Petri  Net  representation  leads  directly  to  the  representation  of 
delays  in  each  stage  of  processing  in  terms  of  an  array  [19] .  Each 
decisionmaker  is  represented  in  the  array  be  a  sequence  of  delays  where  each 
delay  represents  the  time  it  takes  for  a  message  or  task  to  be  processed  by 
a  given  subsystem  of  the  DM.  Each  such  subsystem  appears  as  a  transition  in 
the  Petri  Net  representation  of  the  DM.  The  array  entry  also  indicates  the 
origin  of  the  messages  to  be  processed  as  well  as  their  destination.  The 
presence  of  switches  (decisions)  is  also  shown.  An  algorithm  has  been 
designed  for  the  calculation  of  delays  for  any  origin-destination  pair. 
This  algorithm  is  suitable  for  implementation  on  microprocessor  based 
computers . 
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Figure  5.  Data-flow  representation  of  three  person  organization  structure. 


The  Petri  Net  or  data  flow  framework  provides  a  natural  way  for 
describing  in  a  precise  manner  the  interactions  between  the  DM's  and  the 
data  bases  and  decision  aids  present  in  the  organization.  The  presence  of 
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data  bases,  an  integral  part  of  a  C*  system,  requires  the  introduction  of 
two  additional  modeling  elements.  The  first  is  the  query-response  process. 
The  second  is  the  modeling  of  the  data  storage  devices  themselves. 
Consider,  for  example,  the  situation  assessment  subsystem  shown  in  Figure  6. 
In  accordance  with  the  internal  strategy  u,  an  algorithm  is  chosen  to 
process  the  input  x.  However,  this  algorithm  may  require  parameters  (e.g., 
terrain  information,  meteorological  data)  or  past  situation  assessments  in 
order  to  do  the  processing.  The  data  base  is  accessed  and  queried  for  this 
information  through  the  signal  Dj.  The  data  from  the  data  base  are  provided 
to  the  SA  subsystem  of  the  DM  through  DQ.  The  same  link,  DI,  can  be  used  to 
update  the  information  in  the  data  base.  Clearly,  the  block  diagram 
representation  is  ambiguous:  the  data  flow  formalism  allows  for  the 
precise  modeling  of  the  fact  that  data  are  requested  only  when  certain 
conditions  are  met. 
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Figure  6.  Model  of  SA  subsystem  with  data  base  access 


Consider  next  the  effeot  of  a  data  base  containing  data  that  do  not 
change  dur»  g  the  execution  of  a  task,  i.e.,  the  data  are  fixed.  At  first 


glance.  It  Bight  seem  that  the  addition  of  the  data  base  with  fixed  values 
would  have  no  effect  on  the  total  information  theoretic  rate  of  activity  of 
the  system,  i.e., 

HUj)  -  0  i  -  1.2,. ..,M  (2.21) 

However,  the  problemn  is  more  complex.  For  example,  if  each  algorithm  f^ 
accesses  0^  parameter  values  from  the  data  base  (in  contrast  to  having  these 
values  fixed  within  the  algorithm  itself)  then  the  rates  of  *  throughput , 
blockage,  and  noise  of  the  combined  system  will  not  be  affected,  but  the 
coordination  term  will  have  additional  activity  rate: 

U 

AG  *  5  H[p(u«i) )  (2.22) 
i-1 

Since  a  data  base  increases  the  overall  activity  of  the  system  without 
creating  any  change  in  its  input -output  characteristic,  one  would  question 
its  presenoe.  There  are  several  advantages:  (a)  reduction  in  the 
information  that  needs  to  exist  within  the  algorithms  or  within  the 
decisionmaker  model,  (b)  increased  flexibility  in  the  use  of  algorithms  and 
hence  possible  reduotion  in  the  number  of  algorithms,  and  (c)  aooess  to 
ooonon  data  by  several  organization  members.  Even  though  there  is  Increased 
coordination  activity  due  to  the  interaction  between  the  DM  and  the  data 
base,  the  total  activity  of  the  DM  may  be  reduced  —  the  task  may  be 
redesigned  to  fall  within  the  bounded  rationality  constraints. 

Similar  arguments  apply  to  the  modeling  and  design  of  decision  aids. 
Preprocessors,  a  class  of  decision  aids,  are  assumed  to  be  looated  between  a 
source  (whether  within  the  organization  or  external  to  it)  and  a 
decisionmaker.  The  basic  preprocessor  model  that  has  been  analyzed  [IS] 
employs  a  matching  algorithm  to  partition  the  input  alphabet  so  that  the 
appropriate  decision  strategy  can  be  used  in  the  situation  assessment  stage. 
The  preprocessor  allows  the  use  of  internal  strategies  of  the  form  p(ulx)  in 
place  of  p(u)  in  the  SA  stage.  The  ability  of  the  preprocessor  in  reduoing 


the  workload  of  a  decisionmaker  was  found  to  depend  on  the  input 
uncertainty,  the  decision  strategies  and  the  algorithms  within  the 
preprocessor.  A  preprocessor  that  can  do  filtering  of  input  data  was  shown 
to  upgrade  the  performance  of  a  DM  with  bounded  rationality  by  withholding 
irrelevant  inputs  and,  therefore,  reducing  the  input  rate  to  the  DM.  As  a 
result,  more  time  became  available  to  the  decisionmaker  to  perform  the 
relevant  tasks. 

An  approach  to  modeling  the  organizational  form  —  the  specification  of 
the  structure  and  of  protocols  for  interaction  between  DM's  and  the 
supporting  oommand,  control,  and  comnunication  system  —  has  been 
presented.  It  is  based  on  an  integration  of  Petri  Nets  with  the  information 
theoretic  framework  used  in  the  quantitative  modeling  of  the  decisionmaking 
process.  This  framework  allows  for  the  explicit  representation  of  a  wide 
variety  of  organizational  structures. 

2.7  Analysis  of  Organizations 

As  stated  in  Section  2.4.  it  is  assumed  that  the  designer  knows  a 
priori  the  set  of  desired  responses  Y  to  the  input  set  X.  Then  the 
performance  of  the  organization  in  accomplishing  its  tasks  can  be  evaluated 
using  the  approaoh  shown  in  Figure  7. 


ORGANIZATION 

.  (  A  or  B ) 
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The  organization's  actual  response  y  oan  be  compared  to  the  desired  set  Yd 
and  a  cost  assigned  using  a  cost  function  d(y,Y).  The  expected  value  of  the 
cost,  obtained  by  averaging  over  all  possible  Inputs,  can  serve  as  a 
performance  index,  J,  for  the  organization.  For  example,  if  the  function 
d(y,Y)  takes  the  value  of  zero  vhen  the  actual  response  is  one  of  the 
desired  ones  and  unity  otherwise,  then 

J  -  E  (d(y,Y)}  -  p(y  *  Yd>  (2.23) 

In  this  case,  J  represents  the  probability  *  the  organization  making  the 
wrong  decision,  i.e.,  the  probability  of  error.  Once  the  organizational 
form  is  specified,  the  total  processing  aotivity  Q  and  the  value  of 
organizational  performance  J  oan  be  expressed  as  functions  of  the  internal 
decision  strategies  seleoted  by  eaoh  decisionmaker.  Let  an  internal 
strategy  for  a  given  decisionmaker  be  defined  as  pure,  if  both  the  situation 
assessment  strategy  p(u)  and  the  response  selection  strategy  p(vlZ)  are 
pure,  i.e.,  an  algorithm  f±  is  seleoted  with  probability  one  and  an 
algorithm  hj  is  selected  also  with  probability  one  when  the  situation 
assessed  as  being  2: 

Dk  -  (p(u-i)  -  1  i  p(v-j|Z-2)  -  1}  (2.24) 

for  some  i.  some  j,  and  for  each  2  element  of  the  alphabet  Z.  There  are  n 
possible  pure  internal  strategies, 

n  -  O'y**  (2.25) 

where  U  is  the  number  of  f  algorithms  in  the  SA  stage,  V  the  number  of  h 
algorithm  in  the  RS  stage  and  M  the  dimension  of  the  set  Z.  All  other 
Internal  strategies  are  mixed  [20]  and  are  obtained  as  convex  combinations 
of  pure  strategies: 
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(2.26) 


D(Pk)  -  l  PkDk 
k-1 

where  the  weighting  coefficients  are  probabilities. 

Corresponding  to  each  Dtp^)  is  appoint  in  the  simplex 


5  Pk  “  Pk-0  Vk 

lc-l 


(2.27) 


The  possible  strategies  for  an  individual  DM  are  elements  of  a  closed  convex 
hyperpolyhedron  of  dimension  n-1  whose  vertices  are  the  unit  vectors 
corresponding  to  pure  strategies. 

Because  of  the  possible  interactions  among  organization  members,  the 
value  of  G  depends  not  only  on  D(pk)  but  also  on  the  internal  decisions  of 
the  other  decisionmakers,  k  pure  organizational  strategy  is  defined  as  a  M- 
tuplet  of  pure  strategies,  one  from  eaoh  DM: 


A*.» . M*  tDki*  Dk>',,*’DkM) 


(2.28) 


Independent  Internal  decision  strategies  for  each  DM,  whether  pure  or  mixed, 
induce  a  behavioral  strategy  [20]  for  the  organization,  which  can  be 

expressed  as 


5  <Aa, »...., M  f[  Pk1> 

, . . . ,M  i-1 


(2.29) 


where  pk  is  the  probability  of  using  pure  strategy,  Dk.  Because  each  DM  is 
assumed  to  seleot  his  strategy  independently  of  other  DM's,  the  strategy 
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space  of  the  organization,  S°,  is  determined  as  the  direct  sum  of  the 
individual  DM  strategy  spaces: 


s°  -  s1©  s©...  ©s11 


(2.30) 


where  S1  denotes  the  individual  DM  strategy  space.  The  dimension  of  S°  is 


given  by 


s  ■  dim  S  * 


l  <ni_1) 


Thus,  the  organizational  strategies  are  elements  of  an  s-dimensional  closed 
convex  hyperpolyhedron. 

As  A  ranges  over  S°,  the  corresponding  values  of  the  performance  index 
J  and  the  activity  or  workload  of  each  individual  organization  member  can  be 
oomputed.  In  this  manner,  the  set  S°  is  mapped  into  a  locus  on  the  M+l 
dimensional  performance-workload  space,  namely  the  space  (J,G  ,G  ,...,G  ). 
Vote  that  only  the  internal  processing  aotivity  of  the  decisionmakers  is 
presented  in  the  loous  and  not  the  total  aotivity  of  the  system  which 
includes  the  activity  of  the  decision  aids,  data  bases,  and  other  components 
of  the  supporting  C*  system.  Consequently,  the  bounded  rationality 
constraints  become  hyperplanes  in  the  performance-workload  space.  Since  the 
bounded  rationality  constraint  for  all  DM 's  depends  on  t,  the  admissible 
Internal  decision  strategies  of  each  DM  will  also  depend  on  the  tempo  of 
operations.  The  unconstrained  case  can  be  thought  of  as  the  limiting  case 
when  x  ->•». 

The  methodology  for  the  analysis  of  organizational  structures  allows 
for  the  formulation  and  solution  of  two  problems:  (a)  the  determination  of 
the  organizational  strategies  that  minimize  J  and  (b)  the  determination  of 
the  set  of  strategies  for  which  J  £  J.  The  first  problem  is  one  of 
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optimization  while  the  latter  is  formulated  so  as  to  obtain  satisficing 
strategies  with  respect  to  a  performance  threshold  J.  The  satisficing 
condition  also  defines  a  plane  in  the  performance-workload  space  that  is 
normal  to  the  J  axis  and  intersects  it  at  J.  All  points  on  the  locus  on  or 
below  this  plane  which  also  satisfy  the  bounded  rationality  constraint  for 
each  decisionmaker  in  the  organization  define  the  set  of  satisficing 
decision  strategies.  Analytical  properties  of  this  locus  as  well  as  a 
computational  approach  to  its  efficient  construction  have  been  discussed  in 
[10.11.12] . 

A  qualitative  evaluation  of  an  organizational  structure  can  be  made  by 
comparing  the  performance-workload  loous  to  the  space  defined  by  the 
satisficing  and  bounded  rationality  constraints.  In  the  same  manner, 
alternative  organizational  strutures  can  be  compared  by  considering  their 
respective  loci. 

Since  individual  decisionmakers  select  their  own  decision  strategies 
independently  of  all  other  organization  members,  a  particular  organizational 
form  can  yield  a  broad  range  of  performance  as  illustrated  by  the  locus  in 
the  performance-workload  space.  The  designer  must  assess,  therefore,  the 
likelihood  that  strategies  whiob  lead  to  satisficing  performance  will  be 
seleoted.  A  possible  measure  of  this  consistency  between  individually 
selected  strategies  can  be  obtained  by  comparing  the  locus  of  the 
satisficing  strategies  to  the  locus  of  the  organization's  strategy  space  S°. 
Let  R1  be  the  subspaces  of  organization  strategies  which  are  feasible  with 
respeot  to  the  bounded  rationality  constraint  of  each  DM,  i.e., 

R1  -  [A  I  Gi(A)  <  F1  x)  (2.31) 
and  let  contain  the  strategies  that  satisfy  the  performance  threshold  J: 


The  sub space  of  satisficing  strategies  R°  is  given  by: 

i°-Eln  (2.33) 

The  volume  of  8°,  denoted  by  V(R°)  is  conpared  with  that  of  S°,  V(S°),  to 
determine  the  aeesure  of  consistency.  Q,  i.e.. 

Q  -  V(R°)/?(S°)  (2.34) 

The  ratio  Q  is  a  aonotonie  function  of  J  and  x  with  minimum  zero  and 
aaxlmum  one.  A  null  value  for  Q  iapliea  that  no  combination  of  strategies 
of  the  individual  deoisionaakers  will  satisfy  the  design  specifications, 
while  unity  lap lies  that  all  organisational  strategies  are  feasible,  i.e., 
satisfy  the  bounded  rationality  constraints  and  the  performance 
specifications . 

Sinoe  Q  can  be  expressed  as  a  function  of  J  and  x  only,  it  can  be 
plotted  in  the  three-dimensional  spaoe  (Q.J.t).  A  typical  plot  from  a  three 
DM  exaaple  (12]  is  shown  in  Figure  8. 


Figure  8.  Consistency  measure  Q  versus  J  and  x 


2.8  Conclusion 


The  goal  of  this  task  was  the  development  of  the  elements  of  a 
mathematical  theory  for  the  representation,  analysis  and  evaluation  of 
organizations.  The  class  of  organizations  considered  were  those 
characterized  by  distributed  information  processing  and  decisionmaking; 
furthermore,  the  organizations  are  supported  by  command,  control,  and 
communications  systems. 

The  integration  of  n-dimensional  information  theory  with  the  formalism 
of  Petri  Rets  and  the  consideration  of  cognitive  limitations  in  the 
decisionmaker's  ability  to  perform  his  tasks  have  provided  a  novel, 
integrated  approach  to  the  problem,  A  significant  contribution  of  this  work 
is  that  it  has  led  to  the  analytical  formulation  of  many  organizational 
design  problems  that  have  been  considered  previously  only  in  an  empirical, 
descriptive  context. 

3.0  OTHER  TASKS 

3 .1  Decentralized  Estimation 

(Dr.  D.  A.  Casta Son) 

Estimation  problems  with  fixed  estimator  structures,  namely  distributed 
estimation  problems,  were  studied  by  imbedding  the  estimation  in  a  class  of 
decentralized  decisions  problems.  These  decision  problems  have  special 
structures  which  can  be  exploited  for  some  linear  Qaussian  systems  to  obtain 
closed-form  solutions  for  the  estimators.  In  particular,  the  decision 
variables  do  not  affect  the  evolution  of  the  state  variables  and,  in  certain 
cases,  they  do  not  affect  the  observations  received  by  other  decisionmakers. 
Using  results  from  team  theory,  necessary  conditions  for  optimality  of  the 
estimates  are  derived.  For  fully  decentralized  structures,  these  conditions 
provide  a  complete  closed-form  solution  of  the  estimation  problem.  These 
results  have  been  extended  to  illustrate  how  the  complexity  of  the  local 
estimation  algorithm  depends  on  the  importance  of  correlation  between  the 


•rrors  of  the  various  local  estimators 


This  task  was  completed  in  1981.  A  technical  paper  that  presents  the 
significant  results  of  this  research  effort  is  included  in  Appendix  B  of 
this  report. 

3.2  Information  Storage  and  Flow  in  Systems 
(Ms.  B.  B.  Duoot) 

The  research  objective  of  this  task  was  twofold:  (a)  the  development 

of  adaptive  techniques  for  modifying  and  reducing  the  flow  of  misslon-and 

* 

engagement-dependent  Information  in  a  C  system  operating  under  stress,  and 
(b)  the  development  of  a  small  expandable  software  system  to  support  C* 
system  research.  The  task  was  completed  in  1982  with  the  design  and 
implementation  of  TECCHET  (Testbed  for  Evaluating  Command  and  Control 
METworks) .  The  software  has  been  used  for  studying  the  interactions  between 
data  and  network  management  strategies  and  the  behavior  of  the  network  as 
seen  by  the  information  user. 

The  design  and  implementation  of  TECCNET  are  described  in  a  technical 
paper  included  in  Appendix  C. 

3.3  Distributed  Decision  Problems  in  Dymanic  Missile  Reassignemt  Strategies 
(Prof.  Michael  Athans) 

In  this  task,  a  class  of  generic  air  defense  problems  involving  the 
dynamic  stoohastio  assignment  of  N  defense  interceptors  against  M  incoming 
enemy  targets  was  considered.  Key  constraints  are  generated  by  the 
assumption  that  an  illuminating  radar  must  reflect  energy  from  each  target 
for  a  specific  amount  of  time  so  that  the  interceptor  guidance  law  can  lock 
on  the  target . 


The  modeling  phase  of  this  research  was  completed.  Equations  were 
derived  that  relate  one-on-one  kill  probabilities  and  other  system  variables 
to  the  overall  probability  of  destroying  all  i nooning  targets.  Two 


stochastic  strategies  were  developed:  the  shoot- look-launch  strategy  and 
the  shoot-look-reassign  strategy  (these  include  the  flexibility  of  lauching 
a  salvo  of  interceptors  against  a  target  possibly  followed  by  another  salvo 
after  kill  assessment) .  Numerical  results  for  optimal  stochastic  dynamic 
strategies  for  simple  scenarios  were  obtained. 


The  analytical  results  demonstrated,  however,  that  to  solve 
successfully  this  class  of  dynamic  optimization  problems  one  needs 
significant  modifications  of  the  available  stochastic  dynamic  programming 
theory  and  algorithm. 
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ABSTRACT 


In  this  paper,  we  propose  a  framework  for  the  design  of  linear 
decentralized  estimation  schemes  based  on  a  team- theoretic  approach. 
We  view  local  estimates  as  "decisions'*  which  affect  the  information 
received  by  other  decision  makers.  Using  results  from  team  theory, 
we  provide  necessary  conditions  for  optimality  of  the  estimates.  For 
fully  decentralized  structures,  these  conditions  provide  a  complete 
closed-form  solution  of  the  estimation  problem.  The  complexity  of 
of  the  resulting  estimation  algorithms  is  studied  as  a  function  of 
the  performance  measure,  and  in  the  context  of  some  simple  examples. 
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1.  INTRODUCTION 


A  standard  problem  in  estimation  theory  consists  of  using  a  set  of 
available  information  about  a  random  variable  to  obtain  an  estimate  of 
its  value.  When  the  criterion  used  in  evaluating  the  estimate  is  the 
conditional  variance  of  the  estimate,  the  best  estimator  is  given 
by  the  conditional  mean.  However,  this  formulation  assumes  that  all 
of  the  available  information  is  concentrated  at  a  central  location. 

In  many  areas  of  application,  such  as  Command  and  Control  systems  and 
meteorology,  the  acquisition  of  data  is  characterized  by  sensors 
which  are  spatially  and  temporally  distributed.  Thus,  there  are 
nontrivial  costs  associated  with  the  transfer  of  data  to  a  central 
location  for  the  purpose  of  estimation. 

An  approach  to  designing  estimation  algorithms  for  these  areas 
of  application  is  to  preprocess  some  of  the  data  at  various  local 
processing  nodes,  thereby  reducing  the  communication  load  on  the 
system.  The  result  is  an  estimation  scheme  with  a  fixed  structure 
(often  hierarchical) ,  and  constraints  on  the  available  information 
at  any  one  node.  Figure  1  depicts  a  typical  estimator  structure. 


Figure  1 
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The  structure  of  Figure  1  has  similarities  with  a  decentralized 
decision  problem.  In  this  paper,  we  propose  to  study  estimation  pro¬ 
blems  with  fixed  estimator  structures,  hereafter  referred  to  as  dis¬ 
tributed  estimation  problems,  by  imbedding  the  estimation  in  a  class 
of  decentralized  decision  problems.  These  decision  problems  have 
special  structures  which  can  be  exploited  for  some  linear  Gaussian 
systems  to  obtain  closed-form  solutions  for  the  estimators.  In  part¬ 
icular,  the  decisions  variables  do  not  affect  the  evolution  of  the 
state  variables  and,  in  certain  cases,  they  do  not  affect  the  observa¬ 
tions  received  by  other  decision  makers.  This  latter  case  results 
in  a  partially  nested  decision  problem,  as  defined  in  Ho  and  Chu  11] . 

There  has  been  a  significant  amount  of  recent  work  on  the  subject 
of  distributed  estimation.  The  various  approaches  can  be  divided  into 
two  classes;  The  first  class  consists  of  methods  which  use  the  distri¬ 
buted  structure  of  the  problem  in  such  a  way  as  to  achieve  an  overall 
estimator  whose  error  corresponds  to  that  of  a  fully  centralized  esti¬ 
mator,  and  thus  optimality  is  achieved.  Elegant  solutions  to  some  of 
these  problems  are  presented  in  12] ,  £3] ,  and  14] .  The  second  class  of 
approaches  consists  of  utilizing  a  fixed  structure,  which  is  simple, 
to  achieve  the  best  performance  possible  with  this  restricted  structure. 
This  approach  can  seldom  achieve  the  performance  of  a  centralized  scheme. 
Typical  of  the  results  in  this  case  are  the  papers  of  Tacker,  Sanders  and 
their  colleagues  [5] ,  [6J . 

In  this  paper,  we  follow  the  spirit  of  the  second  approach.  Specifi¬ 
cally,  we  take  as  given  a  specific  architecture  of  processing  stations, 
with  prespecified  flows  of  information  among  them.  Given  this  structure, 
and  the  apriori  statistics  of  the  random  variables  present  in  the  system, 
we  restrict  the  data  processing  to  consist  of  linear  strategies  of  the 
available  data.  It  is  our  purpose  to  characterize  the  "best"  processing 
schemes  in  terms  of  am  overall  performance  measure;  our  estimation  problem 
will  thus  become  a  stochastic  team  problem,  where  a  number  of  decision 
agents  with  different  information  seek  to  minimize  a  common  goal. 
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Fixed  structure  decentralized  decision  problems  have  been  considered 
by  a  number  of  authors  [7],  [8],  and  [9].  Our  approach  in  this  paper 
follows  very  closely  the  formulation  of  Barta  [9]  for  linear  control  of 
decentralized  stochastic  systems.  Indeed,  most  of  the  results  of  Section 
4  of  this  paper  appear  in  Barta  and  Sandell  [10] . 

The  paper  is  organized  as  follows.  Section  2  contains  the  mathe¬ 
matical  formulation  of  fixed  structure  linear  estimation  problems  using 
a  decision  theoretic  viewpoint.  Section  3  presents  general  necessary 
conditions  which  optimal  estimators  must  statisfy.  These  conditions  are 
not  very  useful  due  to  their  complexity.  In  Section  4,  we  specialize 
the  results  of  Section  3  to  a  specific  structure  which  corresponds  to  a 
fully  decentralized  estimation  algorithm.  This  case  permits  significant 
analysis,  as  was  previously  done  in  Barta  and  Sandell  []0].  We  extend 
their  results  to  illustrate  how  the  complexity  of  the  local  estimation 
algorithm  depends  on  the  importance  of  correlation  between  the  errors  of 
the  various  local  estimators.  Section  5  contains  some  simple  examples 
which  illustrate  the  results  of  Section  4.  Section  6  discusses  the  results 
and  areas  of  future  research. 

2.  MATHEMATICAL  FORMULATION 

Assume  that  there  are  N  local  substations  and  one  coordinator  station 
in  the  decentralized  estimation  systems.  Denote  the  state  of  the  environ¬ 
ment  by  x(t),  an  Rn-valued  random  process  on  [0,T]  whose  evolution  is 
governed  by  the  stochastic  differential  equation 

dx(t)  «  A(t)x(t)dt  +  B(t)dw(t),  (2.1) 

where  w(t)  is  an  R1"-  valued  standard  Wiener  process.  Each  local  substation 
receives  data  from  local  measurements,  described  by  the  observation  equations 


dy. (t)  -  C. (t)x(t)dt  +  D, (t)dv. (t) 


(2.2) 
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where  v^(t),  w(t)  are  standard,  mutually  independent  Wiener  processes,  and 
yi(t)  is  an  -  valued  random  process.  The  matrices  A(t),  B(t),  c^(t),  D^t) 
are  assumed  continuous  an  [0,T]  for  i  =  0....N.  In  addition,  the  matrices 
Di(t)  are  assumed  invertible  for  all  i,t. 

To  each  local  substation  corresponds  a  decision  agent,  whose  decisions 
are  denoted  by  u^(t)  in  R^i.  The  decisions  made  at  each  substation  depend 
only  on  real-time  observations  of  local  data,*as  in  equation  (2.2),  plus 
the  apriori  knowledge  about  the  statistics  of  the  systems.  The  apriori 
knowledge,  common  to  all  local  substations  and  the  coordinator  station,  con¬ 
sists  of  knowledge  of  the  matrices  A(t) ,  B(t),  C±  (t) ,  D^t),  for  i  =  0,...N, 
t  e  fO,T],  together  with  the  initial  distribution  of  the  initial  condition 
x(0).  For  the  sake  of  simplicity,  we  assume  that  x(0)  is  a  zero-mean,  normal 
random  variable  with  covariance  £ (0) . 

The  coordinator  station  receives  the  decision  outputs  of  all  the  local 
subsystems,  u^(t),  i  =  1,...N,  in  addition  to  an  independent  set  of  measure¬ 
ments  y. (t) .  The  output  of  the  coordinator  station  is  denoted  by  u  (t) ,  and 
o  o 

it  is  based  on  real-time  observation  of  measurements  and  the  prior  decisions 
of  the  local  substations. 


Associated  with  the  estimation  structure  is  a  performance  index,  of  the 


form 


J-«|/ (u<t)  -  s(t)x(t)7  Q(t)  (u(t)  -  S(t)x(t))dt,  |  (2.3) 


where  u(t)  consists  of  the  vector  of  decisions, 


uT(t)  -  (u^(t) , . . . ,u^(t) ) , 


(2.4) 


and  the  superscript  T  denotes  transposition.  The  matrix  Q(t)  is  assumed 
positive  semidefinite  and  continuous  for  t  in  10,T].  With  this  performance 
criterion,  the  design  of  a  distributed  estimation  scheme  can  be  reduced  to 
determining  the  admissible  decision  strategies  which  minimize  the  quadratic 
function  J. 
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The  admissible  strategies  are  restricted  to  be  linear  maps  of  the 
available  information  which  yield  mean-square  integrable  decision  variables. 
Specifically,  since  equation  (2.2)  implies  that  the  local  observations  are 
corrupted  by  additive  white  noise,  we  assume  that,  for  i  =  l,...n. 


ui<t)  =  J  Hi(t,s)dyi(s) 


(2.5) 


where 


HA(t,s)  =0  if  s  >  t, 


(2.6) 


T  T 


Trace  f  f  Hi(t,s)H^(t,s)dtds  <  «. 
Jo  Jo 


(2.7) 


For  the  coordinator,  we  assume  that 


u  (t)  * 
o 


l  Ho<t.s)dyo(»l  ♦ J  /  Ki(t,s)ui(s)ds 


+1  L  (t)  u  (t) 
i=l  1 


(2.8) 


where  Hq,  satisfy  (2.6)  and  (2.7),  while  the  matrices  (t)  are 
continuous  on  [0,T] . 

The  parametrization  of  the  control  laws  in  equations  (2.5)  to  (2.8) 
results  in  admissible  strategy  spaces  which  are  Hilbert  spaces.  Specifically, 
the  admissible  strategies  for  u^  i  *  1,...N,  are  elements  of  the  Hilbert  space 
of  linear  operators  from  I>2  ([0,T],  Rni)  to  L2([0,T],  RPi)  with  finite  trace, 
and  inner  product 

T  T  T 

<H  ,  H  >  -  Trace  f  C  H1(t,s)H2  (t,s)dtds  *  Trace  (H  H*)  .  (2.9) 

Jo  Jo  12 


For  additional  information  about  Hilbert  spaces  of  operators,  the 
reader  should  consult  Balakrishnan  (11] .  We  will  use  the  symbol  Hi  with¬ 
out  its  arguments  to  refer  to  the  linear  operator,  while  H^tjS)  will  be 
used  to  refer  to  the  kernel  of  the  operator. 
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The  assumption  of  linear  strategies  for  all  decision  agents  in  the 
problem  represents  a  restriction  on  the  class  of  admissible  strategies. 
However,  the  system  and  observations  described  by  equations  (2.1)  and  (2.2) 
result  in  zero-mean,  jointly  Gaussian  random  processes  x,yo»...yN.  since 
the  decisions  u(t)  do  not  affect  the  evolution  of  the  state  x(t)  (this  is 
a  property  of  estimation  problems)  for  any  control  law  u(t)  such  that 


T 

E J  |  |u(t)  |  j  2dt  <  00 , 


(2.10) 


we  can  use  a  version  of  Fubini's  theorem  to  show 


■{4s 


(u(t)-S(t)x(t) )  Q(t) (u (t) -S (t) x (t) ) >dt . 


(2.11) 


Notice  that  the  optimal  estimator  will  minimize  the  integrand 
J1  -  E  |  (u(t)-S(t)x(t))TQ(t)  (u(t)-S(t)x(t))| 


(2.12) 


almost  everywhere.  In  many  cases,  this  will  enable  us  to  show  that  the 
true  optimal  solution  belongs  to  the  admissible  class  of  linear  strategies. 

To  conclude  this  section,  we  will  discuss  some  relevant  examples,  and  indicate 
how  they  fit  in  this  framework. 


Example  1:  Centralized  estimation 

Assume  that  N  *  0,  so  that  the  only  station  present  is  the  coordinator 
station.  In  this  case,  corresponds  to 
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iQ(t)  -S  (t)  x  (t) )  Q(t)  (u^  (t) -S  (t) x (t) )  > . 


Its  minimum  among  all  mean-square  integrable  u  (t)  is  achieved  at 


u  (t)  -  S  (t)x  (t) 
o 


(2.13) 


where  x(t)  is  the  minimum  variance  estimate  of  xfc,  given  the  prior 
observations,  which  is  obtained  from  a  Kalman  filter.  Hence,  the  optimal 
estimator  is  linear. 
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Example  2.  Hierarchical  Estimation 


Let  N  *  2.  Furthermore,  let  PQ  =  =  ^2  =  n  anci 
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Assume  C  (t)  ®  0.  * 
o 


Then,  equation  (2.12)  yields 


■ E  lh 


(t)-x(t))  (u 


i(t)-x(t))J. 


We  consider  the  minimization  of  over  all  mean-square  integrable  decision. 

The  last  two  terms  in  the  sum  are  minimized  by  using  local  Kalman  filters  at 
each  local  substation.  Furthermore,  it  was  established  in  W:.llsky,  Castanon  et 
al  (2] ,  that  the  first  term  can  be  minimized  absolutely,  when  the  local  strate¬ 
gies  are  Kalman  filters,  by  a  strategy  of  the  form  (2.8).  Hence,  the  optimal 
hierarchical  estimator  for  this  problem  is  in  the  class  of  linear  estimators. 

Example  3.  Fully  Decentralized  Estimation 


Assume  that  there  is  no  coordinator  station,  so  that  u  (t) s  0  for  all  t. 

o 


In  this  case. 


*  E  j(u(t)-s(t)x(t)  )T  Q(t)  (u (t)  — s (t)x(t)  )|  . 


For  each  t,  this  is  a  static  team  problem  with  jointly  Gaussian  statistics,- 
hence,  Radner's  theorem  [12]  implies  that  the  optimal  decision  strategies  are' 
linear  maps  of  the  available  observations,  and  hence  they  belong  to  the  linear 
class  in  equations  (2.5)  to  (2.8). 


Example  4.  Let  N«l,  p^*l,  p«n,  and 
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Then, 


Jx  -  E  |  (uo(t)-x(t))T(uo(t)-x(t))| 

It  is  clear  that,  if  n  >  1,  some  form  of  nonlinear  encoding  of  the  infor¬ 
mation  will  provide  a  lower  value  of  J1  than  the  best  linear  encoder, 
because  ^  is  a  scalar  signal  and  x  is  a  vector  process.  In  this  case,  the 
optimal  decision  rules  are  nonlinear. 

In  many  cases,  the  optimal  estimation  strategies  will  be  nonlinear. 
Nevertheless,  there  will  be  a  person-by-person-optimal  linear  strategy 
which  will  be  of  interest  because  of  ease  of  implementation.  In  the  next 
Section,  we  provide  necessary  conditions  which  characterize  these  linear 
person-by-person  optimal  strategies. 

3.  NECESSARY  CONDITIONS 

The  formulation  of  Section  2  imbedded  the  distributed  estimation  pro¬ 
blem  into  a  team  decision  problem  with  a  quadratic  criterion,  where  decision 
rules  are  elements  of  a  Hilbert  space  of  linear  operators.  In  this  section, 
we  provide  necessary  conditions  which  charafcterize  the  estimators  resulting 
from  this  approach.  The  mathematical  development  of  this  section  follows 
closely  the  development  in  Barta  [9] . 

In  operator  notation,  equations  (2.5)  and  (2.8)  can  be  written  as 


u^  ■  H^(dy^),  i  *  1,...N 

(3.1) 

N 

u  -  H  dy  +  T  (K.u,  +  L.u.) 
oo  o^ii  xi 

i»i 

(3.2) 

is  the  linear  operator  with  kernel 

I>i (t , s)  «  Li(t)6(t-s) 

(3.3) 

Furthermore,  the  quadratic  functional  (2.4)  can  be  written  as 
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J  -  E  (u(t)-S(t)x(t))TQ(t)  (u(t)-S (t)x(t) )dt 

-  Trace  Is*QsT  +  qT  2qT  S*f 
j  ‘•xx  t-uu  -  ^UX  1 


(3.4) 


where  J.ux»  and  J.uu  are  the  covariance  operators  [11]  corresponding  to  the 

random  processes  x(t)  and  u(t).  Note  that  the  decision  operators  are 
implicit  in  defining  u(t)  as  a  random  process. 

Let's  partition  u  as 

u (t)  »  tu  (t) !  u  (t) . . .u  (t)]T  *  [u  (t),u(t)]T  (3.5) 

-  Oil  N  O 

Then,  T  can  be  partitioned 
‘-uu 


l  l  - 

**u  u  Lu  u 

o  o  o 


I  -  I- 

4*U  u  Luu 

o 


(3.6) 


Furthermore,  u(t)  is  related  to  y(t)  by 


_H1  ' 

u(t)  » 

L  vl 


(3.7) 


so  that 


Similarly, 


diagjlT  J  y(t) 


Uu  =  (diag  V  Uydy  (diag  V* 


^u0“  "  [HoW(Jdy1  Hl*  “Ho^>dyodyN  Hn  ] 


(3.8) 


v-  iv  .v  .v, 


N 

+  7  l(K.+L.)H.  L  j  H*  . . . (K.+L. )H.  7 .  .  H*] 

i-i  1  1  j-  L*vj*Yl  i  iii  ^dyidyN  « 


(3.9) 


and 


a  -  Ho  dy  HS  +  j,  <Ho  £<iy  dy.  HI'K‘  *  LJ> 
O  O  O  O  1*1  Jo  1 


+ (K.+L. ) H .  I*  H*} 

l  i  l  ‘•dy  dy.  o 


o  x 


N  N 


+  l  l  (K.+L. )H.  L  ^  H*  (K.+L. 

ill  ^dy^y  333 


)  (3.10) 


A  similar  partition  yields 

I. 


X 


ux 


-u  X 

o 


h 

'•ux  J 


(3.11) 


where 


N 


L  ■  H  y.  +  T  (K.+L.)  H.  T 
hi  x  o  ‘•dy  x  ,L.  i  i  i  ‘* 


o  i-1 


-dyix 


L  ■  ih.  . ..h  L  i 

‘•Qx  i  ‘•dy.x  N  Ldy„x 
1  N 


(3.12) 


(3.12) 


Using  equations  (3.6)  -  (3.13)  in  equation  (3.4),  we  can  express  the  functional 
J  as  a  deterministic  quadratic  function  of  the  operators  L^»  K^,  which  are 
elemsnts  of  a  linear  Hilbert  space.  We  will  denote  this  dependence  by 

J  -  J  (H,  L,  K) 
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(3.14) 


Since  J  is  a  quadratic  functional,  and  the  linear  operators  H,  L,  K  are 
elements  of  Hilbert  spaces,  we  can  compute  the  Frechet  differential  of  J 
[13]  with  respect  to  variations  in  the  operators.  In  particular,  we  will 


denote  the  Frechet  differential  of  J  in  the  direction  of  each  of  the  com¬ 


ponents  of  H,  K  and  L.  Partition  the  operators  Q,  S,  according  to  equations 
(3.6),  as 


'«oo  *01' 


(3.14) 


^lo  ®11- 


(3.15) 


Then,  we  cam  use  equations  (3.6)  -  (3.15)  to  obtain  the  Frechet  differentials: 
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(3.16) 
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-  Q  S 
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(3.17) 
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H.)  *  2  Trace  1  f(K*  +  L*)Q  H  L  . 
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where  Q^q»  Q^»  S*  are  the  blocks  partition  in  the  corresponding  partition 
of  u(t)  -  (u,  (t) , . .  .u^t)  )T. 


Using  expressions  (3.16)  -  (3.18),  we  can  provide  necessary  conditions  for 
optimality  of  a  set  of  linear  maps  (H,K,L) ,  as  follows: 


Proposition  3.1  If  H,K,L  minimize  the  functional  J  over  the  space  of 
all  linear  maps, then 


(a)  6J  (H,ic,L  ;  8)  -  0 

H  O 

O 


5j  (H,K,L  I  K  +  L  )  -  0 

X  1 


<h,k,l  }  8.)  -  0 

Hi  1 
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for  all  i=l,...N,  and  for  all  admissible  K.,L.,H  and  H  . 

i  1  i  o 

Proof  The  proof  follows  directly  from  Theorem  1  in  Chapter  7  in  Luenberger  [13] , 
since  the  existence  of  Frechet  differentials  provides  an  expression  for  the 
Gateaux  differential,  which  must  be  zero  at  a  minimum. 

Proposition  3.1  can  be  used,  together  with  the  fact  that  admissible  operators 
H,K,L  are  Volterra  inteqral  operators,  to  obtain  sets  of  coupled  integral 
conditions  which  characterize  the  optimal  solution,  in  a  manner  similar  to 
Wiener-Hopf  factorization  [14] .  We  will  not  do  so  here,  focusing  instead 
on  obtaining  the  expressions  which  characterize  the  optimum  in  the  specific 
case  of  equations  (2.2)  -  (2.3)  for  the  fully  decentralized  case  in  the  next 
section. 


4-  FULLY  DECENTRALIZED  ESTIMATION 

In  the  fully  decentralized  case,  the  coordinator  station  is  absent. 

In  terms  or  the  formulation  of  section  3,  the  operators  K^,L^  and  Hq  are 
identically  zero,  as  are  the  weighting  matrices  Sq,  Qqo»  and  2->0'  for  a1^ 
time  t  in  [0,T] .  This  causes  an  extensive  simplification  in  the  equations 
of  Proposition  3.1.  Specifically,  equation  (3.18)  now  becomes 


6 -■  J(H; H. )  =  Trace 
H .  1 

1 


(r  N 

[  i- 


Hj  ^■dyjdyi 


XJ*  1  H* 
^dy . x  i 

i  J 


(4.1) 


The  equivalent  set  of  integral  equations  corresponding  to  equation  (4.1) 
are 


dyjdyi(8l's)dsI"  (QUSl(t)1  E, 


(t,s) 


(4.2) 


A  similar  equation  can  be  found  in  Barta-Sandell  [10] ,  where  a  solution  is 
found  using  an  innovations  approach.  We  will  present  a  different  derivation 
of  their  results  in  this  section. 
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Assume  that  >  0  and  is  constant  in  time.  This  implies  that  the 
cost  functional  J  is  strictly  convex ,  so  that  there  is  a  unique  minimum, 
which  is  characterized  by  the  integral  equation  (4.2).  Furthermore,  as¬ 
sume,  without  loss  of  generality,  that  all  decisions  u^  are  scalar -valued, 
that  is  -  1  for  all  i.  A  vector-valued  decision  can  be  decomposed  into 
p^  stations  with  the  same  information.  Hence,  the  assumption  in  equation 
(2.3)  that  the  v^  are  mutually  independent  Wiener  processes  will  be  re¬ 
moved  at  this  stage,  to  allow  for  this  development. 

We  begin  by  noting  that  equation  (4.2)  is  a  linear  equation  driven 
by  a  sum  of  terms  in  the  right  hand  side.  Hence,  by  superposition,  the 
optimal  solution  i^(t,s)  can  be  written  as 

A  N  n  Zk 

H .  (t ,  s)  -  l  l  G7(t,s)  S».  (t)  (4.3) 

3  Z-lk=l  3  ** 


where  G.  (t,s)  minimizes  J  when  S  =  6».  ,  that  is,  it  has  a  one  in  the  Ik  tl> 
3 

entry  and  zero  elsewhere.  Hence,  G.  (t,s)  solves 


j^ii  /af  -  °u 


(4.4) 


Notice  that  the  form  of  Q  determines  the  form  of  the  linear  system  on  the 

Zk 

left  side.  It  is  possible  to  solve  for  all  G.  simultaneously,  because  of 
the  consistency  of  the  problems  (4.4).  Let  denote  the  cost  function  J 
when  s  «  6^.  Then, 


(G^,  ...G^)  =  argmin  J^tG**) 
5lk 


(4.5) 


Define  a  global  cost  J  ,  given  by 


jV'1....?'")  -  l  l  /NS*) 

Z=lk=l 


(4.6) 


T  T 

The  cost  J  is  separable  in  its  arguments.  Hence,  minimization  of  J  corres¬ 
ponds  to  solving  equation  (4.5)  for  each  t, k. 


Let's  examine  closely  the  nature  of  the  costs  J  .  From  equation 
(2.4) ,  corresponds  to 

J**  -  E  jjf  (u(t)  -  <5i_£Vt))T  5  (H(t)  ■  6i-l\(t))dt 

where  d.  »  is  a  vector  with  all  zeroes  except  a  one  in  the  £'th  entry. 

£k 

Furthermore,  minimization  of  is  accomplished  by  minimizing 
-  E  (u  (t)  -  6i_^xJc(t))TQ(u(t)-6i _^x  (t)) 


(4.7) 


(4.8) 


for  each  t.  Let  d  (t)  correspond  to  the  n  x  N  matrix 

i 


di<t)=  ; 


(4.9) 


representing  the  decision  variables  associated  with  problems  ,  k=l,...n 
in  (4.6) .  Let  D(t)  be 


dx(t) 


dN(t) 


L 

be  an  n  N  x  N  matrix.  Then,  a  simple  calculation  establishes  that 


*  Trace  E  J(D(t)-X(t))  Q(D(t)-X(t)  )T 


(4.10) 


where  the  i-th  column  of  D(t)  is  a  linear  function  of  the  local  observation 


process  y^(t)  only. 


This  is  the  same  formulation  used  in  Barta-Sandell  [10] .  He  will 
state  their  main  result  without  proof,  as  it  applies  to  systems  of  the  form 
(2.2)  -  (2.4).  Before  we  can  do  so,  we  must  introduce  some  notation. 

The  state  process  of  equation  (2.2)  is  given  by 

dx (t)  -  A(t)  x(t)dt  +  B(t)dw(t)  (4.11) 

with  local  observations 

dy^  (t)  *  C  (t)  x(t)dt  +  D^(t)dv^(t)  (4.12) 

where  v^(t),  w(t)  are  standard  Brownian  motions  with  w(t)  independent  of 
all  v^(s) . 

Let 

A(t)  «  diag  {aU)  ,...A(t)| 

8(t)dw(t)  *  diag  ^B(t)dw(t) , . . .B(t)dw(t)| 

C(t)  »  diag  (t) , . . .Cn(t)|  (4.13) 

then,  we  have 

dX(t)  «  A(t)X(t)dt  +8(t)dw(t)  (4.14) 

Define  also 

Qn1  •••  Q1nx 

.  diag  [B(t)BT(t),...B(t)BT(t)]  (4.15) 

^l1  •*’  <V 

as  the  enlarged  system  relevant  driving  noise  intensity. 

Similarly,  define 


- 


iw(t> 


QllDl(t)Dl(t)  Q1NE  Di(t)dv1(t)dvN(t)DN  (t) 


V  E  j  Vt)dVH(t>  dVl,t,D»(<;)  | 


•eN«DN<t)D»(t) 


(4.16) 


as  the  enlarged  system  relevant  observation  noise  intensity.  With  this 
notation,  the  main  result  of  [10]  is: 


Proposition  4.2  The  Decentralized  Kalman  Filter 

A 

The  optimal  team  decision  rule  for  equation  (4.10),  X(t),  satisfies 

dX±  (t)  -  A(t)  X±  (t)dt  +  K(t)  tlidyi(t)  -  CltJX^t)]  (4.17) 


where 


K(t)  -  ]>(t)  CMt)  t) 


M 


T  T  T  T  r 

[O  , . . .1  , . . .0  ]  is  a  I  m.  x 

i=l  2 


nu  dimensioned  matrix  with 


the  identity  in  its  ith  block,  and  £(t)  solves  the  Ricatti  equation 

,T  . . r  „T, 


l  -A.(t)J  +X  AT  (t)  -  K(t)^K  (t)  + 


(4.16) 


l(o) 


Qu1  •••  Q1ni 


diag 


The  estimator  of  Proposition  4.2  is  depicted  in  Figure  2.  The  striking 
feature  of  this  estimator  is  that  each  local  agent  uses  identical  esti¬ 
mation  systems,  of  dimension  NnxN,  differing  only  in  the  input  used  to 
drive  the  systems.  However,  in  many  applications,  these  estimators  are 
much  larger  than  are  necessary.  In  particular,  it  is  important  to  note 
that  it  is  the  presence  of  Q  which  creates  nontrivial  couplings  in  the 
team  problem,  leading  to  large-dimension  estimators. 
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When  Q  is  diagonal,  the  expresions  for  I  (t)  and  £  (t)  are  block-diagonal. 

In  this  case,  it  can  be  established  that  £(t),  as  given  by  equation  (4.16) 
will  also  be  block-diagonal,  and  the  optimal  estimator  will  decompose  into 
blocks  of  much  smaller  dimension.  We  formalize  this  in  the  following 
proposition . 

Proposition  4.3  Assume  Q  is  diagonal.  Then,  the  optimal  decision  rule  which 
minimizes  (4.10)  can  be  synthesized  using  n-dimensional  estimators  at  each 
local  station. 

The  proof  follows  directly  from  equations  (4.15)  and  (4.16).  In  the 
next  section,  we  will  study  some  specific  examples  to  illustrate  the  com- 
lexity  of  the  algorithm  of  Proposition  4.2,  and  the  relation  of  the  off- 
diagonal  elements  of  the  matrix  Q  with  this  complexity. 

5.  EXAMPLES 


In  this  section,  we  discuss  some  examples  of  fully  decentralized  esti¬ 
mation  problems,  indicating  their  relation  with  the  results  of  section  4.  To 
facilitate  the  understanding  of  the  examples,  we  will  discuss  only  non¬ 
dynamic  Gaussian  systems. 

Example  1.  Let  x^x^  ^  ^dependent,  zero-mean  Gaussian  random  variables 
with  unit  variance.  Define  the  two  observation  equations 

yl  *  xi  +  vx  (5.1) 

y2  “  X2  +  V2  (5.2) 

where  v^,  x^,  x^  are  mutually  independent,  normal,  zero-mean  random  vari¬ 

ables  with  unit  variance. 

Assume  that  there  are  two  local  substations.  Each  substation  i  has 
access  to  its  own  measurement  y^  The  performance  of  the  elements  is  to 
be  evaluated  as 


2ux  -  0 


Repeating  for  y0  and  u_  yields 
%  •  2 


2u2  -  E  {x2jy2)  *  0 


Hence ,  for  S 


a 


,  the  optimal  strategy  is 


■  0 


u2  =  1/2  E  (x2|y2) . 


As  indicated  in  Section  4,  the  solution  for  S  =^g  is  the  superposition 
of  the  solutions  for  s  *  ® j  and  S  * * j  . 

The  presence  of  the  off  diagonal  elements  of  Q  =  is  important  in 

creating  the  nature  of  the  solution.  Notice  that,  in  spite  of  the  inde¬ 
pendence  x^yj^  and  *2>Y2'  that  the  optimal  estimator  for  S  |j  is 

not 

o  -c  dc  33 


Example  2 


Assume,  in  example  1,  that  x^  =  x2*  Repeating  the  same  logic  for  obtaining 
the  optimal  solution  for  ®  “(q  *  we  obtain  the  sufficient  conditions 


2ux  -  5  E  (xx | yx>  +  E{u2|y1)  =  0 
2u2  -  4  E  {x2|y2J  +  E{u1|y2)  ■  0 


(5.5) 


the  coupled  equations  (5.5)  can  be  solved  by  noting  that  u^  *  ay^,  u2  =  by2 , 
for  some  constant  a,  b.  Equation  (5.5)  becomes 


2ux  -  5  Etxjy^  +  bE{y2|y1)  -  0 
2u2  -  4  E{x2|y2>  +  aE{y1ly2)  -  0 


(5.6) 


NOW/ 


Efy^y^  -  Efxjy^ 
ECyj^lyj)  -  E(x2|y2) 


So, 


a  yi  "(j  “  |)  Eixjy^ 

,  (5.7) 

b  y2  -  2  -  a/2  E{x2|y2> 

Rewriting  in  terms  of  contants , 

a  +  b/4  -  5/4 

b  +  a/4  -  1 

so  a  -  16/15  (5.8) 

b  -  11/15 

Equation  (5.8)  was  obtained  by  solving  the  simultaneous  euqations  obtained 
from  the  variational  arguments.  For  differential  systems,  these  equations 
will  be  aoupled  integral  equations  which  are  hard  to  solve. 

Let' 8  establish  the  solution  (5.8)  using  the  decomposition  approach  of 
Section  4.  Let  S  ■  ^  q|  •  Then,  the  performance  measure  is 

J  -  EifUj-x^2  +  (u1>x1)u2+u2J 

Variational  arguments  yield 
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2ux  -  2  E  {x1|y  }  +  E(u2|yi}  =  0 


2u2  -  E(x2|y2)  +  E(u1|y2)  =  0 


(5.9) 


which  imply  a  *  7/15  ,  b  =  2/15 


By  symmetry ,  the  solution  for  S 


a  =  2/15  b  =  7/15 


For  S 


P 


»  the  performance  measure  is 


J  -  EUu^x^ 2  +  (Uj^-XjJUj  +  u2} 

«  EfCUj^-Xj^)2  +  (u^x^u  +  U2} 


which  has  already  been  solved,  yielding 
a  =  7/15  b  =  2/15 

Summary  all  three  yields  the  result  for  S  ^  as 

a  -  7/15  +  2/15  +  7/15  -  16/15  ^ 

b  «  4/15  +  7/15  -  11/15 

We  will  now  use  proposition  4.2  directly  to  solve  example  2.  since  x^^  *  x2» 
the  effective  state  dimension  is  1.  Hence,  the  matrix  D  in  Section  4  has 
dimension  2x2,  with  the  first  column  a  function  of  y^,  while  the  second 
column  is  a  fucntion  of  y2>  The  overall  team  cost  is  given  as  in  (4.10),  by 


J  ■  Trace 


[<D-  fc»)>  (Ui/2)">-  (S  °) >T ] 


The  optimal  solution  X  is  characterized  by 


1 


/.4 


dtI- 


Q  D*  j  -  0 


(5.10) 


for  any  D  whose  first  column  is  a  function  of  and  its  second  column  a 
function  of  y^.  Let 


(Vi  biM 

Wl  b2y2 ' 


(5.11) 


Equations  (5.10)  and  (5.11)  imply 


/Vl-  ^  )  g  f  1 

' a2yl  a2y2~X'  '°  y2' 


(5.12) 


which  reduces  to 


C  y-lc-  :,)«(:•  :S)H(:  :>«(:■  :,)h 


Let's  compute  the  terms  in  equations  (5.13) 


Hence, 


!c‘X:iC‘  ;,)!■( 

ic  >(:■  :j  ■  c;n 


2  1/2' 
1/2  2 


f 1  \  (l  1/2\  l2  1/2\  .  ( 

\  2  V  \l/2  V  \l/2  2 1  V 


7/15  2/15 


2/15  7/15 


The  solution  for  S  = 


is  thus 


ux  -  (2  .  7/15  +  2/15)  y  *  16/15  y 


u2  -  (2  .  2/15  +  7/15)  y2  =  11/15  y2» 


as  was  established  before. 


Notice  that  a  diagonal  Q  would  have  decoupled  the  problem  by  permitting 
a  trivial  inversion  of  a  diagonal  matrix,  as  predicted  in  proposition  4.3. 


CONCLUSION 


We  have  presented  a  framework  for  the  design  of  distributed  estimation 

*• 

schemes  with  specific  architectures,  based  cn  a  decision  theoretic  approach. 
For  a  fully  decentralized  architecture,  explicit  solutions  to  the  estima¬ 
tion  problem  were  described  and  illustrated  with  several  examples.  The 
examples  illustrate  that  the  complexity  of  the  decentralized  estimation 
scheme  is  critically  dependent  on  the  importance  of  the  cross-correlation 
of  errors  in  the  local  estimators,  which  are  represented  by  the  off-diagonal 
elements  of  the  positive  definite  matrix  Q.  Most  practical  systems  will  want 
to  weigh  heavily  the  correlation  of  local  errors.  For  example,  in  a  dis¬ 
tributed  surveillance  network,  it  is  important  that  errors  in  location  or 
detection  at  one  local  substation  be  corrected  by  other  substations.  In 
other  words,  it  is  very  costly  for  all  substations  to  err  in  the  same  way. 
This  is  reflected  in  the  performance  measure  by  the  off-diagonal  elements  of 

Q. 


The  examples  in  Section  5  illustrate  the  high  dimensionality  required 
by  the  local  estimators  in  order  to  compensate  for  correlations  in  their 
errors.  It  is  our  conjecture  that  the  dimensionality  of  the  local  estimators 
is  directly  related  to  the  number  of  off-diagonal  elemets  of  Q. 


When  there  is  a  coordinator  station  present,  the  results  presented  in 
Section  3  provide  necessary  conditions  for  the  optimality  of  the  estimation 
operators.  Unfortunately,  the  coupling  between  decisions  at  the  local  sub¬ 
stations  and  the  information  available  to  the  coordinator  makes  the  analysis 
a' difficult  problem.  We  expect  that,  under  some  simplifying  assumptions, 
the  necessary  conditions  of  Section  3  can  lead  to  a  solution,  as  in  Section  4 
Such  results  have  been  reported  in  Willsky,  Castanon  et  al  [2]  for  a  simple 
class  of  performance  measures. 

The  formulation  of  Section  2  can  be  extended  to  incorporate  communi¬ 
cation  restrictions,  as  well  as  delays  in  the  transmission  of  local  decisions 
These  are  areas  which  will  be  studied  in  the  future. 
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TECCNET:  A  Software  Testbed  for  Use  in  C3  System  Research1 


Elizabeth  R.  Ducot 

Laboratory  for  Information  and  Decision  Systems,  Massachusetts  Institute  of 
Technology,  Cambridge,  Massachusetts 


Abstract.  TECCNET  (Testbed  for  Evaluating  Command  and  Control  NETuorks) 
is  a  small,  expandable  software  system  created  to  support  C3  system 
research.  It  has  been  designed  to  facilitate  the  modeling  and  analysis  of 
the  complex  interactions  between  the  distributed  command  and  control 
network  elements,  the  algorithms  and  procedures  that  characterize  the 
information  flow  networks  of  which  these  elements  are  a  part,  and  the 
environment  within  which  they  must  function.  The  TECCNET  system  provides  a 
software  laboratory,  with  a  flexible  interactive  structure,  in  which  basic 
system  research  functions  are  performed.  These  functions  include:  the  on¬ 
line  description  of  the  problem  of  interest  and  the  definition  of  a  model  to 
be  studied,  the  generation  of  an  appropriate  scenario,  and  the 
execution  of  the  desired  experiment.  A  progression  of  experiments  using 
TECCNET  has  been  planned  to  serve  a  dual  purpose.  For  the  near  term,  the 
focus  will  be  on  the  areas  of  distributed  information  network  management  and 
decentralized  estimation.  This  will  allow  necessary  building  blocks  to  be 
created,  contributing  toward  the  development  of  an  Information 
Intermediary  that  is  Intended  to  resolve  conflicts  between  the  needs  of  C3 
system  users  and  the  capabilities  of  the  C3  networks. 


INTRODUCTION 

The  need  to  provide  dynamic  limitations  on 
the  flow  of  information  in  a  Command, 
Control,  and  Communications  (C3)  system  has 
become  increasingly  apparent.  Indeed,  this 
need,  coupled  with  the  requirement  that  the 
C3  systems  operate  effectively  under  a 
variety  of  adverse  conditions,  has  provided 
the  motivation  for  much  of  the  recent  C3 
system  research.  TECCNET  (Testbed  for 
Evaluating  Command  and  Control  NETuorks) 
is  an  experimental  software  laboratory, 
designed  in  response  to  this  need  in  a  way 
that  will  support  a  number  of  complimentary 
research  activities.  Before  describing  the 
structure  and  characteristics  of  TECCNET,  it 
is  appropriate  to  summarise  the  point  of 
view  taken  in  creating  this  research  support 
system. 

In  this  work,  the  C3  system  is  visualized  as 
an  information  flow  network.  Thia 
description  encompasses  not  only  the 
communications  systems  that  transmit  data 
and  messages,  but  also  the  processing  and 
storage  systems  that  acquire,  translate, 
manipulate,  and  disseminate  information.  The 
performance  of  this  network  may  be  described 

'This  work  was  supported  initially  by  the 
Air  Force  Office  of  Scientific  Research 
(Contract  Number  AFOSR-80-0229).  Support  for 
the  continued  development  of  the  system  has 
been  granted  by  the  Office  of  Naval  Research 
(Contract  Number  ONR/NOOO1R-77-C-0532) . 


(at  least  conceptually)  in  terms  of  its 
ability  to  deliver,  at  designated  points, 
the  desired  information  so  that  upon 
arrival,  it  is  timely,  accurate,  complete, 
and  easy  to  use. 

The  underlying  C3  system  problem  that 
motivated  the  design  of  TECCNET  is 
extremely  complex.  The  system  elements 
comprising  the  information  flow  network  are 
highly  distributed,  have  diverse  physical 
characteristics,  and  are  often  governed  by 
ill-defined  operational  constraints  and 
procedures.  The  technologies  that  affect  the 
elements  of  this  system  are  changing 
rapidly;  advances  in  electronic  weaponry, 
sensors,  and  computers,  for  example,  combine 
with  changes  in  the  way  information  la  used 
by  the  commander  to  increase  both  the  flow- 
of  information  in  the  network  and  the  time 
pressures  associated  with  its  delivery. 

Even  under  somewhat  benign  conditions,  the 
task  of  supporting  this  flow  of  information 
is  a  formidable  one.  However,  when  the 
tactical  situation  intensifies,  the  load  on 
the  system  Increases  substantially,  just 
when  the  external  stress  on  the  network 
Induced  by  a  hostile  atmosphere  is  at  its 
peak.  Competition  for  the  same  resources  to 
move,  process,  store,  and  display 
information  also  intensifies  —  frequently 
with  disastrous  results  (i.e.,  excessive 
message  delays,  system  and  user  information 
overloads,  etc.).  Thus,  the  C3  system, 
viewed  in  terms  of  how  well  it  provides  the 
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information  support  expected  by  the 
decision-maker,  is  perceived  to  degrade 
exactly  when  it  is  most  important  that  it 
operate  well:  when  battle  information  is 
flowing  and  the  time  available  for  decision 
making  is  short.  It  follows  then  that  there 
is  need  to  modify  the  information  flow  to 
match  it  in  real-time  to  the  facilities  and 
the  time  available  for  processing. 

The  research  problems  formulated  from  the 
preceding  statements  share  a  common  premise: 
in  order  to  develop  techniques  for 
controlling  the  flow  of  Information 
effectively  in  a  C3  context,  one  must  be 
able  to  express  and  exploit  the 
relationships  between  the  activities  of  the 
user  and  the  conditions  of  the  network.  This 
premise  is  evident  in  research  efforts 
addressing  all  levels  of  the  information 
flow  system  —  the  control  of  the  underlying 
communication  network,  the  way  information 
is  generated  and  used,  and  ultimately  the 
Interface  between  the  human  users  and  the 
systems  (Ducot,  I960  and  1982).  As  a  result, 
one  of  the  first  goals  in  the  development  of 
TECCNCT  was  to  encourage  the  Integration, 
within  a  common  framework,  of  the  relevant 
ideas  drawn  from  diverse  research  areas 
(i.e.,  distributed  data  base,  sensor  and 
network  management,  information  processing 
and  presentation,  etc.). 

Along  with  the  common  premise  indicated 
above,  a  common  concern  has  been  expressed 
over  the  potential  cost  (both  in  terms  of 
system  and  user  resources)  of  implementing 
proposed  information  flow  control  schemes. 
Hence  the  second  hope  in  creating  the 
TECCNET  system:  that,  through 
experimentation,  a  better  understanding 
could  be  developed  of  the  complex 
interactions  between  the  distributed  command 
and  control  network  elements,  the  various 
models,  algorithms  and  procedures  that 
characterize  the  Information  flow,  the 
needs  of  the  users  of  the  C3  systems,  and 
the  environment  within  which  these  systems 
must  function. 

Ultimately,  however,  the  objective  in 
creating  TECCNET  is  to  promote  the 
development  of  new  models  for  representing 
the  C3  information  processes  and  new 
concepts  for  dealing  with  the  resulting 
information  flow.  An  important  goal, 
therefore,  is  to  provide  the  type  of 
environment  that  will  foster  a  broad  range 
of  research  activities  and  will  facilitate 
the  testing  of  proposed  algorithms  and 
procedures.  In  the  next  section,  the  design 
and  characteristics  of  the  TECCNET  system 
are  described  briefly,  followed  by  a 
discussion  of  the  initial  plans  for  its  use 
as  a  research  tool. 


TECCNET:  THE  SYSTEM  IN  OUTLINE 

la  order  that  TECCNET  meet  the  goals 
outlined  above,  a  number  of  design 
objectives  were  established.  Based  on  these 


objectives,  a  skeleton  system  was 
implemented  at  MIT  beginning  in  1981. 
Development  of  the  system  continues  within 
this  same  framework: 


1)  The  testbed  should  be  SHALL,  with  a 
controlled  plan  for  expansion,  so  that  it 
will  remain  a  manageable  tool  for  project 
research. 

2)  The  software  should  be  structured  so 
that  it  can  operate  in  a  multi-user 
environment  and  meet  the  needs  of  users  with 
different  levels  of  software  and  system 
expertise.  Moreover,  the  system  should  be 
interactive \nd  provide  considerable  on-line 
documentation. 

3)  System  interface  and  support  software 
should  be  developed  to  facilitate  both 
modeling  and  testing  activities. 

4)  Default  models  and  representations  of 
the  system  should  be  available  in  order  to 
reduce  the  effort  required  to  initiate 
simple  experiments. 

5)  The  modeling  tools  created  for  the 
TECCNET  system  should  make  it  easy  for  the 
user  to  represent  the  asynchronous 
interactions  and  complex  protocols  that  are 
characteristic  of  the  models  and  algorithms 
to  be  explored. 


The  preceding  statements  encompass  a  broad 
range  of  system  capabilities — capabilities 
outside  those  customarily  associated  with 
software  for  algorithmic  and  system 
research.  As  a  result,  the  final  design  of 
TECCNET  and  the  open-ended  plans  for  its 
development  resemble  procedures  for  the 
design  of  computer  operating  systems 
(Corbato,  Saltzer,  and  Clingen,  1972)  as 
much  as  they  do  those  applied  to  the  type 
simulation  system  software  originally 
anticipated  (Oren,  Shub,  and  Noth,  1980). 

This  dual  nature  of  the  software  is  apparent 
in  the  organization  of  TECCNET,  depicted  in 
Figure  1.  Three  basic  research  functions, 
designated  1)  the  Model  Generator,  2)  the 
Scenario  and  Input  Generator,  and  3)  the 
Information  Network  Simulator,  are  supported 
within  an  interactive  structure.  A  brief 
description  of  the  funtional  elements 
follows.  The  reader  is  referred  to  a 
discussion  of  the  software  system  (Ducot, 
1982)  for  additional  detail  and  sample 
TECCNET  interactions. 


The  Model  Generator 

The  Model  Generator  is  the  first  of  TECCNET 
components.  It  permits  the  user  to  specify 
the  modeling  environment,  and,  in  some 
sense,  to  build  the  simulation  on-line.  A 
view  of  the  C3  Information  flow  network  is 
defined  by  combining  models  of  the  local 
processing  nodes,  constraints  on  the 


eoveoent  of  messages,  protocols  governing 
the  information  flow,  and  the  algorithas  for 
managing  the  network.  In  general,  these 
specifications  are  tightly  coupled,  bound 
together  by  the  need  for  consistency  in  the 
modeling  assumptions.  Sets  of  simulation 
specifications,  along  with  descriptions  of 
any  built-in  assumptions,  may  be  stored  in 
the  system  as  defaults  —  defaults  which  can 
then  be  manipulated  by  the  user. 

For  example,  one  such  set  (currently  in 
place  within  TECCNET)  permits  analysis  at 
the  level  of  the  nodes  and  links  comprising 
a  store  and  forward  data  communication 
network.  In  this  case,  the  Queueing  model 
of  the  processing  elements  used  is 
extremely  simple.  Processing  of  data  packets 
is  assumed  to  take  "zero"  time  compared  to 
packet  queueing  and  transmission  delays.  The 
link  buffers  at  the  nodes  are  not  modeled 
explicitly;  their  capacities  are  reflected 
in  an  effective  link  capacity  that  la  a 
fraction  of  the  physical  limit  of  the  line. 
Moreover,  the  transmission  and  receipt  of 
packets  are  assumed  to  be  perfect  processes. 
Certain  characteristics  of  the  message 
traffic  (exclusive  of  volume)  also  have  been 
specified  as  defaults.  For  simplicity,  data 
packets  are  assumed  to  have  the  same  average 
length,  and  only  one  conversation  may  be 
aotive  between  a  pair  of  nodes  at  any  given 
time.  A  first-in-first-out  (FIFO)  service 
discipline  is  used  for  the  treatment  of  dat* 
packets,  with  preemptive  logic  for  both  the 
control  packets  and  acknowledgements  having 
a  higher  priority  in  the  system. 

The  structure  ard  content  of  the  data 
packets  are  not  given  for  this  simple 
default  model;  data  comprise  background 
traffic  within  the  network.  Control 
messages,  on  the  other  hand,  require 
explicit  treatment  of  both  structure  and 
content,  as  these  messages  are  used  as 
signals  to  drive  the  TECCNET  algorithas.  An 
Initial  network  management  algorithm  (an 
outgrowth  of  an  original  distributed  routing 
scheme  developed  by  Gallager  (1977))  which 
utilizes  the  preceding  modeling  assumptions, 
is  included  as  part  of  this  modeling 
environment. 

A  library  structure  has  been  developed  to 
house  modeling  specifications  and 
algorithmic  building  blocks.  Descriptive 
information  is  associated  with  each  entry  in 
the  library  in  order  that  the  user  may 
select  among  default  models  and  procedures. 
Additional  specifications  can  be  added  to 
modify  an  existing  modeling  environment,  or 
to  specify  a  new  one  as  desired  by  the  user. 


Scenario  Generator 

The  Input  Generator  is  the  data-lntenslve 
component  of  the  TECCNET  System  in  which  the 
user  defines  the  conditions  to  be  simulated. 
For  the  sample  view  of  the  network  indicated 
above,  three  steps  are  required:  1)  the 
specification  of  the  network  topology, 


capacity  of  the  links  etc.,  2)  the 
association  of  nodes  with  particular 
processing  models  and  descriptions  of  the 
traffic  between  them,  and  3)  the 
representation  of  the  environment.  As  the 
modeling  of  the  information  flow  network 
elements  becomes  more  sophisticated, 
additional  inputs  representing  different 
types  of  decision  variables  will  be 
developed. 

Inputs  are  solicited  from  the  user  at  the 
terminal  in  free  form.  These  data  are 
organized  into  permanent  files  and  are 
catalogued  with  descriptive  comments  that 
later  may  be  displayed  on-line.  The  files 
may  be  shared  between  users,  each  of  whom  is 
given  a  private  working  copy  that  functions 
as  a  data  base  during  his  input  session. 
Sample  sessions,  indicating  how  the  data 
bases  are  created  and  manipulated  by 
TECCNET,  are  presented  in  (Cucot,  1982). 

Scenario  Inputs  (describing  the  condition  of 
the  Information  flow  network)  are 
distinguished  from  those  that  define  the 
experiment  (such  as  number  of  iterations, 
convergence  criteria,  cost  function 
parameters,  type  of  statistics  to  be 
collected,  etc.)  and  are  stored  separately. 
Thla  distinction  is  best  appreciated  by  the 
user  who  attempts  to  combine  "canned" 
scenarios  and  model  specifications  for  use 
in  multiple  experiments.  The  scenario 
building  process  may  occur  in  small  segments 
at  different  TECCNET  sessions  until  a 
complete  scenario  has  been  obtained  and 
stored  in  the  system. 


Network  Simulator 

Once  a  model  and  scenario  of  interest  have 
been  established,  the  execution  phase  of  the 
experiment  can  be  initiated.  Discrete 
event  simulation  techniques  form  the  basis 
of  the  execution  software.  This  permits  the 
Integration  of  many  procedure-driven  models 
and  the  representlon  of  asynchronous 
operation  of  the  elements  of  a  distributed 
system. 

Three  types  of  events  are  modeled, 
designated  for  purposes  of  discussion 
"external”,  "spontaneous",  and  "responsive". 
External  events  are  derived  from  the 
environment,  and  refer  to  situations  arising 
outside  the  network.  These  events  are  not 
modeled  within  the  system  in  detail;  they 
are  represented  only  as  time-dependent 
effects  applied  to  one  or  more  of  the 
capabilities  of  the  system  elements. 

Spontaneous  events  simulate  actions  that  are 
based  solely  on  Internal  logic  operating  at 
the  nodes  of  the  information  flow  network. 
Thus,  these  internal  events  correspond  to 
the  decoupled  actions  of  a  cooperating 
member  of  a  distributed  system.  These  events 
may  take  many  forms  depending  on  the 
modeling  environment  that  has  been 
specified.  The  most  straightforward 


spontaneous  event  is  a  scheduling  event. 
An  example,  drawn  from  the  current 
distributed  communication  algoritha,  is  the 
oommand  from  an  individual  node  signalling 
the  Initialization  of  a  routing/flow  control 
update  cycle  that  will  change  the  flow 
within  the  network.  A  slightly  sore 
elaborate  fora  of  the  scheduling  event  is  a 
conditional  one,  in  which  soae  quantity 
(observable  at  the  node)  Is  aonltored  until 
a  threshold  Is  reached,  at  which  tlae  the 
event  Is  scheduled.  Internal  clocks 
(synchronized  or  unsynchronised)  are 
aaintained  at  the  nodes  to  deteraine  the 
activation  tiae  for  the  spontaneous  events. 

Execution  of  a  spontaneous  event  say 
initiate  a  sequence  of  responsive  events. 
Comunicatlon  with  other  nodes  In  the  system 
is  required  to  generate  one  or  more  of  the 
events  in  the  sequence.  Since  responsive 
events  are  triggered  only  by  the  receipt  of 
an  appropriate  control  message,  they  are 
used  to  aodel  the  various  forms  of 
cooperative  actions  among  the  distributed 
network  elements. 

The  event  generator  as  currently  implemented 
is  only  partially  Interactive.  The  user  is 
on-line  while  the  simulation  is  running:  he 
aay  view  the  results,  request  that  output  at 
various  levels  be  displayed  or  suppressed, 
and  decide  whether  or  not  to  continue  the 
experiment.  In  the  future,  the  user  of 
TECCNET  will  be  permitted  a  dual  role:  that 
of  researcher  who  Is  observing  the 
experiment,  on  the  one  hand,  and  that  of  C3 
information  network  customer  who  is  changing 
inputs  and  requests  in  real  tlae,  on  the 
other.  Thia  additional  capability  Is 
reflected  in  the  presence  of  an  interactive 
node  in  Figure  1. 


Conversational  Interface 

The  Conversational  Interface  provides  the 
link  between  the  user  and  the  body  of  the 
TECCNET  system.  Communication  is 
interactive,  with  commands  and  responses 
entered  and  displayed  at  the  user's 
terminal.  The  forms  of  the  interaction  can 
be  controlled  by  the  user,  and  the  display 
level  ("verbose"  or  "terse")  aay  be  set  by 
him  according  to  bis  familiarity  with  the 
system. 

This  Interface  software  is  basically  command 
driven;  a  feature  which  gives  a  user 
considerable  flexibility  in  his  use  of  the 
system.  This  Is  a  "user  active"  style 
generally  preferred  by  the  designers  of 
interactive  systems,  reflecting  the  fact 
that  experienced  users  can  learn  to  bypass 
detailed  explanations  and  move  efficiently 
through  the  system.  Occasslonly  however, 
when  complex  descriptions  or  order-dependent 
responses  must  be  solicited  from  the  user, 
the  user  motive  mode  Is  suppressed  by  the 
Conversstlonal  Interface,  and  a  more 
restrictive  question  and  answer  (or  "user 
pssslve")  format  is  employed. 


Whenever  the  user  message  (••••USEE: :) 
appears,  TECCNET  la  awaiting  Input  froa  the 
user.  A  specially  designed  command-line 
Interpreter  monitors  the  user's  entry  to 
distinguish  the  following:  1)  signals  for 
movement  within  TECCNET  (motion  commands), 
2)  requests  for  Information  (help  commands) 
and  3)  specific  data  entries  (responses  to 
system  prompts  and  questions). 

Motion  commands  allow  the  transfer  between 
the  basic  user  activities.  For  example,  the 
coMand  "model"  places  the  user  in  a 
position  to  define  his  modeling  environment. 
Unlike  motion  commands,  help  commands  (which 
provide  on-line  documentation  and 
clarification)  have  no  positional  properties 
and  aay  be  issued  without  limit  at  any  tine. 
When  a  help  command  is  received  by  TECCNET, 
the  information  requested  is  displayed  at 
the  terminal,  at  which  time  the  user  may 
continue  bis  session  as  though  no  Interrupt 
bad  occurred.  If  a  specific  question  had 
been  asked  of  the  user,  the  question  Is 
repeated  at  the  end  of  the  help  message. 

These  same  help  messages  can  also  be  used  to 
provide  on-line  training  for  the  user.  This 
requires  that  an  underlying  sequence  for 
command  use  be  evident  during  the 
Interaction.  TECCNET  messages  contain  the 
suggestion  of  a  next  logical  command  at  the 
end  of  each  response;  suggestions  which  aay 
be  used  by  the  user  to  guide  him  through  the 
system  description.  As  an  example,  a 
partial  sequence  of  commands  and  responses, 
used  as  an  introduction  to  the  system,  is 
depicted  in  Figure  2. 


USE  OF  TECCNET 

The  preceding  presentation  of  the  TECCNET 
modeling  system  has  provided  a  brief 
Indication  of  bow  the  software  has  been 
structured  to  support  C3  system  research. 
Since  the  major  goal  in  the  development  of 
TECCNET  is  to  promote  the  evolution  of  new 
approaches  to  information  flow  control,  the 
plans  for  using  the  TECCNET  system  as  a 
research  tool  are  of  immediate  Interest.  A 
significant  payoff  is  anticipated  if  the 
experiments  can  be  structured  into 
experimental  building  blocks;  each  of  which 
contributes  a  portion  of  the  Insight  and 
experience  necessary  to  proceed  to 
successively  higher  levels  of  abstraction  in 
viewing  the  information  flow  network. 

One  of  the  chief  beneficiaries  of  such  an 
approach  is  expected  to  be  the  effort  to 
develop  the  Information  Intermediary 
(Ducot,  1962)  which  addresses  the 
information  related  interactions  at  the 
highest  system  level  —  the  interface 
between  the  user  of  the  information  and  the 
C3  network  Itself.  The  Intent  of  this 
Intermediary  is  to  assist  the  buman  user  of 
the  C3  system;  aiding  him  to  reformulate 
bis  requests  for  information  and  to  change 
his  use  of  the  information  flow  network  in 


light  of  network  conditions.  In  order  to 
introduce  notions  of  flow  control  for 
information  (as  opposed  to  data)  into  the 
network,  the  Intermediary  must  have  access 
to  a  specially  developed  local  status  model 
of  the  system;  a  model  that  Integrates 
dynamic  network,  data  base,  and  user 
information  and  requires  the  flow  of 
control  information  between  network 
elements.  In  other  words,  this  model  must 
reflect  the  interactions  between  three  types 
of  information  management  procedures: 
1)strategles  that  induce  changes  in  routing 
and  control  of  data  flow,  given  network 
parameters,  2)crlteria  for  .  modifying 
decisions  governing  th%  generation  and 
injection  of  Information  into  the  system, 
given  these  same  or  related  status 
Indicators,  and  3)changes  in  approaches  to 
information  retrieval,  given  the  behavior  of 
the  network. 

In  considering  candidate  approaches  on  the 
basis  of  their  compatibility  and  potential 
contribution  to  such  a  model,  three 
desirable  features  were  identified.  The 
first  is  the  feasibility  of  representing 
proposed  technique  for  detecting  flow 
conditions  and  for  exerting  necessary 
control,  in  a  way  that  can  be  Implemented 
via  a  distributed  algorithm.  The  second  is 
the  ability  to  formulate  the  control  actions 
and  decisions  to  be  exercised  at  the  nodes 
based  on  limited  local  information.  And 
third  is  the  possibility  of  sharing  common 
status  Information  and  network  parameters 
among  different  types  of  management 
algorithms. 

These  characteristics  were  considered  in 
determining  the  first  step  in  the  TECCNET 
utilization  plan;  development  of  a  modeling 
baseline  from  which  a  broad  class  of 
techniques  for  managing  the  communication 
network  could  be  studied.  The  initial 
algorithm  Included  in  the  TECCNET  system  is 
representative  of  a  procedure  (type  1)  that 
Induces  changes  in  data  flow  given  network 
conditions.  This  approach  (extended  from 
the  original  formulation  (Gallager,  1977)  by 
Golestaanl  (1980))  treats  flow  control  and 
routing  together,  leading  to  a  flow  control 
algorithm  that  is  expressed  in  terms  of 
the  following  conflicting  objectives:  to 
reduce  congestion  in  the  network  while  at 
the  same  time  minimizing  the  amount  of 
offered  traffic  that  is  rejected  by  that 
network.  A  convex  optimization  problem  is 
formulated  in  which  short-term  average 
information  on  network  utilization  is  used 
to  allocate  both  maximum  data  rates  for 
user  sessions  (viewed  as  source/destlnatlon 
pairs)  and  the  optimum  routes  through  the 
network  for  information  flowing  within  it 
(Gallager  and  Golestaanl,  1980). 
From  the  point  of  view  of  potential 
contributions  to  the  model  required  by  the 
Information  Intermediary,  the  appeal  of  this 
initial  approach  lies  in  the  formulation  of 
the  distributed  algorithm,  the  type  of 
marginal  delay  information  coenunlcated, 
and  the  structure  of  priority  functions 


that  represent  the  cost  of  rejecting  flow 
between  individual  node  pairs. 

The  second  of  the  TECCNET  building  blocks 
presumes  the  existence  of  both  the  real-time 
status  Information  (of  the  type  described 
above)  and  the  distributed  algorithm  by 
which  it  is  communicated.  The  experiments 
being  considered  as  part  of  this  second 
phase  (Ozbek,  ongoing),  represent  the  first 
attempt  in  the  TECCNET  framework  to 
associate  the  criteria  for  generating  and 
injecting  information  into  the  network  with 
the  network  parameters  themselves. 

The  decision  variables  are  drawn  from  a 
formulation  of  a  decentralized  estimation 
problem  in  which  explicit  use  is  made  of  the 
fact  that  communication  from  sensors  to 
estimators  is  not  instaneous.  The  normal 
incentives  to  obtain  high  quality  estimates 
by  transmitting  complete  information 
frequently  between  nodes,  are  recognized  as 
being  far  from  optimal.  As  part  of  this 
research  effort,  a  number  of  tradeoffs 
dealing  with  the  generation  and  scheduling 
of  information  reporting  can  be  addressed. 
Of  immediate  Interest  are  those  describing: 
1)  the  frequency  of  reports  (relating  raw 
data  reporting  frequency,  traffic  volume, 
delay,  and  the  use  of  sensor  information) 
and  2)  the  quality  of  reports  (frequent 
compressed  reports,  partially  processed  at 
intermediate  nodes,  versus  the  less 
frequent  receipt  of  nearly  raw  data. 

With  the  experience  gained  in  creating  these 
two  building  blocks  (type  1  and  type  2 
procedures),  it  is  hoped  that  the  next  stage 
in  the  TECCNET  utilization  plan,  the 
incorporation  of  information  retrieval 
strategies  (type  3),  may  be  initiated  in  the 
not  too  distant  future. 


CONCLUSIONS 

In  the  preceding  sections,  the  design,  and 
intended  use  of  a  new  research  tool,  created 
especially  to  support  C3  system  research, 
was  presented.  The  potential  contributions 
to  a  variety  of  ongoing  research  activities 
were  considered  in  the  development  of  the 
initial  version  of  TECCNET,  now  operational 
at  KIT.  Preliminary  experience  with  the. 
TECCNET  software  suggests  that  the  design 
objectives,  outlined  at  the  beginning  of 
this  paper,  are  being  met.  The  interactive 
format  and  modular  structure  of  the  system 
appear  appropriate  to  the  needs  of  users 
with  different  levels  of  software  and 
system  expertise  who  will  be  participating 
in  this  aotlvity  in  the  future.  The 
modeling  tools  incorporated  in  the  system 
provide  the  capability  for  representing  the 
asynchronous  interactions  and  complex 
protocols  Inherent  in  the  models  .  and 
algorithms  likely  to  be  explored. 
Development  of  the  system  is  continuing. 
Additional  default  modeling  environments 
will  be  Included  to  allow  the  pursuit  of 
several  lines  of  inquiry  in  parallel,  each 


of  which  is  expected  to  contribute  s 
different  perspective  to  the  overall 
development  of  inforastion  flow  control 
techniques.  It  is  anticipated  that 
extensive  use  of  the  TECCNET  ays tee  will 
lead  as  a  by-product  to  aodlfleatlons  and 
iaproveaents  in  the  system.  As  these 
enhancements  are  Bade,  it  ia  hoped  that  the 
scope  of  the  inforastion  flow  modeling 
activities  will  continue  to  broaden. 
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Fig.  1  Structure  of  TECCNET 


TtCCNCT: 

Welcome  to  trx  Information  Flow  Not  work  Testbed  (TtCCNCT). 
For  Inform* t  tori  on  now  to  uu  tno  lyitM,  type: 
no  Ip 

followed  by  a  carriage  return.  Otnarwtaa.  on  receiving  tno 
usar  eua  :  I  you  oay  typo  any  TECCNtT  command. 


•••*USt»: : 
help 

♦♦•♦TfcCNtT: 

TtCCNCT  la  an  Intaraetlwa  testbed  wnien  la  Intended  to  aupport 
tno  analyals  of  a  nuobar  of  Inforoatlon  flow  related  taauoa.  It  Is 
structural  to  provide  usar  support  In  tnroo  aroaa: 

1)  tno  apoelf leatlon  of  nis  modeling  environment .  aaloctlon 
of  local  nods  nodal a.  message  protocols  and  flow  control 
strategies.  ( prograo  aapnant :  'nodal*) 

2)  tho  gonoratlon  of  simulation  Input  and  acsnanos  that  dofino 
tho  network  /  traffic  conditions,  (program  sagnont:  'sconarlo') 

3)  tno  on- 1 1 no  aaacutlon  of  tno  simulation  oaporlnont  (progran 

sagnont:  'run'). 

For  Information  on  now  to  Intaract  with  tno  TECCNtT  system,  tno 
Inexport  usar  snow  Id  typo:  usa 

-•-•USfP: : 
uso 

♦♦♦♦TtCCNf T : 

Vou  conwarsa  with  TtCCNCT  by  ontarlng  commands  and  rssponaos  from  your 
terminal.  When  tno  usar  cuo  (••••USER::)  apoaars.  It  Is  tho  Indication 
that  you  may  begin  typing.  To  signal  tho  computer  that  you  nave  conplotad 
your  entry  you  MUST  strike  tho  carriage  return  (CP)  key.  Tho  computer  will 
not  respond  until  you  do. 

Tho  commands  permit  you  to  mows  f rooty  within  tho  TtCCNCT  system, 
to  asorctsa  the  various  programs,  or  to  receive  explanations  and 
assistance  In  program  selection  and  data  preparation.  Occasional ly. 
a  specific  response  Is  rogulred.  In  these  Instances,  you  will  be 
prompted  from  the  terminal  before  tho  user  cue  Is  given. 

Depressing  the  BREAK  or  ATTN  key  at  any  time  will  Interrupt  TtCCNCT 
and  return  you  to  a  point  whore  you  may  again  enter  commends . 

The  Inexpert  user  should  now  typo: 

commands 


•eewUttP: : 


eeeeTCCCNCT: 

The  basic  commends  for  controlling  and  Interacting  with  the  TtCCNCT 
system  aro  organised  Into  three  groups: 

1)  movement  within  the  system: 

model:  to  change  modeling  environment 
sconarlo:  to  Croats  scenario  data 
run:  to  execute  the  experiment 

atop:  to  leave  the  system 

2)  on-line  documentation: 

help:  brief  description  of  TtCCNCT 
uso:  outline  of  Interaction  modes 

help  model,  help  scenario,  halp  run:  descriptions  of 
tno  TtCCNCT  submodels 

usa  model. usa  scenario,  uso  run:  Instructions  for  their  uso 
help  network,  help  traffic:  description  of  Input  parameters 

3)  user  support: 

help  error:  how  to  correct  errors  In  typing 

help  comment:  how  to  leave  comments  about  tho  system 

comment :  comment  mechanism 

•tftoi  ro»<est  for  brief  Interactive  reporting 
verbose:  request  for  complete  Interactive  reporting 


Flc.  2  Introduction  to  TECCNET:  A  Tutorial 


